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' INTI^ODUCTION 



This report describes the attitudinal responses of students, site 
coordinators, and' college faculty 'consul tants tx) the various learning * 

activities,^ the delivery system, and the equipment associated with a 

■• - ■ . ' V - - - 

course entitled .Diagnostic and Prescriptive Reading Insrtruction during the 

sprnmer of 1974. The. course was produced by- the. Appalachian Education 

Satellite Projecf for> television broacicast v-ia satellite to sites iw^he 

Appalachian region. 

The Appalachian Education Satellite Project (AESP) began in 

^ . ' . . . , ^ ' - , ■ , T '^ 

June,l973, with a grant fV^om the Wattonal Institute of Education (Nl|?)r'^^ 
j|:o t'he Appalachian Regional Commission (ARC). The purpose of ^the project 
was^to demonstrate the feasibility of conducting graduate level courses 
for teachers usin^' sophistioatedj^tiortal Aeronautics and Space Admin- 
istration (NA$/\^) •eommunicafions satellites. The four course^ sJeveloped 
for the project were in the areas of-'^areer education and reading 
instruction. All softwar^e for the courses was developed at the Resource 
Coordinating Center (RCC) loca^ted on the campus of the University of 
Kentucky in Uxirigton, Kentucky. / 

*A total of four courses^ two in reading' and two in career - 
education were/^nducted via satel 1 ite between June, 1974-and June, 1.975. 
The course participants cbnsisl^ed of approximately 1200 JteachGV*s (300 peV 
course) gathered a^f^classroom sjtes at JS^diff^r^nt locations In the 
Appal ach i an reg i on . The si tes We-re^locateiJ.^ in ;e i.ght .dl^fjf ef^entf states;, 



from Alabama to New York, /and were grouped into sets of three: a main 
"site and two ancillary sitesn Main^ sites were able to receive aydio and 
video signals transmitted from ^he RCC via the ATS-6 ^ate^l 1 ite and could 
receive and send voice/or teletype signals to or from the RCC and other 
main -sites via the ATS-3 satellite.' Ancillary sites could receive audio 
and video signals transmitted from the RCC via ATS-6 and were in telephone 

communication with the associated main si te.N Ancillary sn'tes could not 

' , \ * ' - ' ■ 

receive or transmit via ATS-3. All sites were equipped with a color 

television monitor and had adequate seating for 20 students. The location ^ 

of each site and the . broadcast "footprint" of '1:he satellite are shown in** ' 

Figure 1. \- • I 

Th§ ^monitoring of- classroom sites and many other project related 

tasks conducted, at the local level were the responsibility of project staff 

* ■ . 

members, caLled site coordinators, employed at participating Regional 

V , . ,. . , , . 

Education Service Agencies (RESAs) affiliated with the Aprpalachi an Regional 

■ - 

Commission (ARC). A full description of the duties tff the site coordinator 
can be found in AESP Technical Report #2 jAusness and Bowling, 1974). 
,: , The Diagnostic and Prescriptive Reading Instruction (DPRI) course 
for K-3 teachers wag condOcted Tjsing the two NASA satellites during the ^ 

' ■ ' . ■ 

summer Of 1974. The course was de^^igned so that high quality instruction 
and the opportunity for studervfc .interaction- with content experts was 
possible, though it was- not necessary for an expert in reading in,struction 
to be on-site during' class meetings. The course consisted of twelve . 
thirty-mi nytev (color) videotaped lessons-;- twelve associated audio review 
segments' (one for each videotaped lesson); l^oratory activities and 



FIG. 1 ^MAP OF 't'HE APPAI;ACHIAN^KEGrGN^ - 
"SHOWING THE FIVE , RE^A' WASTERS ^ JREGEIVlNG * 
TRI^pLES, AND A^^P^OXIMATE SATELLITE" {FOOT 



4^- 




p. "^o^^^ N.Y; ::'|;;i, 

■JC. « Edinborb, ,Pa.:y;^^/ 
•b. /Cu^ber^lan<J, M^>.,J - 

E. ^ Mcrtfenry, Md. '/'^ ; 

F, K^sef W. Va. Z"^^: 
O. ^'Norton, Va.> > / 

/,SJ^lcklyvxlliei' y^.. 



Boone , N . C- 
Johnson^ City , TenA. 
LaFollett^, Tenn. 
Coalfield , Tenn. 
HuntsvClle', Ala. 
Raihsv'ille, Ala. ^ 
Gunt^rsville, Ala . 



• 1, i 



■ ' /V- ' ■ . ' . . ■ ■ ^ 
related reading^'materials ; unif testsV a'nM 'thfee forty-five minute,^ 

. • * . ' " - . , - ■ * 

]ive<^ interactive\(co1or)- Seminar pr^ogi^anis. ^ \ .^-^^ ' • %^ , 

The DPRI course was deAAelbped by Dr\ Lowell Eb^rwein^, Associate 

• ^ i ■ ' ^ • \ . \ ■ . ' \ 

. Professor of CurricuTum and Instruction aj:- the University of Kentucky, ^ 

and Raul LeVeque, .a Producer-Director at 4Jniversity of Kentucky Television ^ 

* "'^^ ? 

y in cooperation with^many other professionals on the AESP staff. The 

^ ' ' ' * , • ^ " ' , , • 'u - : 

.purpose 0% the course was to teach -educators to recognize and asses?s 

reading deficiencies, to iise diagnostic-prescriptive-informatfon systems, 

to^apply a large number of reading-improvement, techjiiques, and to condcict * 

individual i2;ed and^^cgup .iri'Struction^ The course was designed tg focus - 

on the needs of Appalachiajn teachers, and conside^rable use was made of 

regional filming in iMustrating points ^made in the lecjtOre. Every _ • 

effort was made, within the time frame of the. production schedule,. to 

» . 

involve teachers, adminjstratoV^s and'other schop> personnel , as wel 1 as 

*' . » 

cooperating .faculty at ve^rious universities and colleges in the Appalachian. 

' • - " ^ - ' • * , ' • 
region, in .the planning and development of the course. Th'e goal was to . , 

^JT^akie the course particularly responsive to the needs and interests of 

teachers in the region. Graduate credit was available to the course 

participants a't the Un-iversity of Kentucky ^ at a number- of cooperating 

; universities tn the region. - 

An outline for'£he DPRI course is iricluded in- Appendix A^ Item,A. 
The twelve thirty-minute videotaped lessons can be desci^bed as stud] 
based lecture presentations %y the^cours^ instructor supported^by filTsed r . 
materials which include teacher-student interactions and interviews .with j 

• the teachens on .how ha/she teaches the skill ijlustrated on film.^^ 
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" > Each of the._ twelve prdtaped audio review segments consisted of , - 
four or five"muUiple choicfe qaestions, with four alternative answers "for 
each question. The procedure employed 'in the use of the audio'review was 
as follows: the student listened to a question and the alternative ^ 
answers over the headsets and selected the alternafive, either a; B, C 
or D, which he-or she believed to be the^correct response to the'question^ 
pbsed; th'en thfe student selected tfie audio' track, or channel , which . • * 
corresponded to , the selected respdps'e, where, an explanation of the - . ^ ^ 

V ■ , ■ ' .• ^' . ' \ ^ . ■ ' . ■ ■ • 

correctness or •incorrectne^-s. of the .answer was given. The .questi-ojis were . ' . 
selected to reinforce aqd expand upon the material presented in^ the ^ 
vitle6taped lecture. Because there were f6ur tracks and the series of 



Iquestiolis was\presented in rigid serial ord^r, the activity was similar 
to programmed instruction in that br^inching within questions was possible; 
however, branching betv/eeh questions was not possible. The special 
Muipmeht necessary for the four channel' audio review, including the 
stui&^ the electronic equipment used for 

automatically recording answers, is described in AESP Technical. Report #5 
(Bramble, Au^nesSf and Freeman, 1975). 

The iive, interactive seminars were' structured in the following' 
way. The course instructor served as moderator for a panel of one 'to , 

three professionals who were experts in the focus area for that particular 

■ ■■■■ ]•- . . ' . ■ . 

seminar. Questions about tife subject matter of the course were trans- 
mitted from the main classroom sites to the Lexington, Kentucky studio ' 
via teletype transmission us.ing ATS-3. Thus, a typed copy of the 
questions was immediately available. Questions from ancillary sites 
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were teletyped via telephone lines to the associated main site and 
were tJhen transmitted to Lexington. To minimize redundancy questions- 
yfere screened in the studio and passed to the panel moderator to be . 
posed to, the seminar. guests . Each question was identified by site as It 

was read over the air. In two cases,- pretaped segments v/ere S'hown at the 

• , ^ . - * ■ ■* 

beginning of the seminar to bett^er define and illustrate a particular* 

area of focus in^th'at seminar. * ' \ . /• , • 

r \ ; , ' , • r ... • ■ 

:/ For each cTas^s session, laboratory activities wer.e conducted after 

* " ■ .* 
complfetion of 'the' ^television. arid a^dio review activities. Each laboratory 

..■ - V * ' , ^ * V . . ^ ' 

.-session was iatended as a practicum, designed to expand upon principles , 
and concepts inj:roduced in the preceeding activities.. Readings, game * . 
activities, .and discussion grougs were ^prominent techniques used during 

-th,ese sessions. The labfiratbry activities also provided instruction in 
the use of the various ^^J^ifo^ made available to course 

participant's at each of jbhe 15 classroom* si tes . Appendix A, Ittm B . 
contains a summary o^ the laboratory activities conducted for each class * 

w C , ■ . . ' 

session. ' " ' 

The overriding project objective of "del i vering the course via . 
^satellite was achieved with minor exceptions. Originally, there were to 

be" ft)ur seminar broadcasts. However, due to problems with the^ satel 1 i te 

r 

uplink it was ngt possible to'bro^d^st both videotapes and the live 
seminars on July 18, Al though j the videotaped presentation scheduled for 

that day was broadcast on a postponed basis, it was not possible to re- 

*f ■ 

schedule the seminar guests V therefore the seminar was cancelled. There 
were a few equipment m^alfunctions at the classroom sites whi qh precluded 



\ 
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the vieviing of .some programs at seve.ra1 sites^ However, videotajDes and 
other materials were jnade available to students at these sites to make . 
up 'the class activities missed. . • , 

The major equipment problem vas associated with the audio review 
equipment, in that •^the equipment was delivered late. In* fact, "the equip- 
ment was avaflable to students for on>y the Tatter half of the programs. 
During the first portion of the course, printed scripts of the audio 
review were substituted so that participants. cduld complete the audio 
Veyiew segments-. However., haying previouslj^rel ie^l on the audio rev-iews 
in print, even V/hen the equipment Was .operationa^T, many students preferred 
halving the scripts in front of them while completing the 'four-channel 
audio review. Therefore, it should be noted that the printed scripts .were 
substituted for the majortty of the programs in completing the" audio 
review. The transmission; deception, and general equipment suetr^sses and 
.failures are detailed" in AESP Technical- Report #5 (Bramble, Ausness and 
Freeman, 1975). . p 

This report discusses the attitudihal reactions of the course 

participants to the several instructional activities that rnade ap ^the 

DPRI course* The perceptions of the site coordinators and consulting 

faculty in regard to the effectiveness of the instructional techniques 

f . ■ • 

are also , discussed. As a result of these discussions, recommendations 

• • *^ 

for improvement of i nstruct*ional techniques will be made. 



■\ < ' . METHOD • . / 

SObjects- . ' ^ 

* . :■ ~ ^ 

Data were collected from three groups: 1) course participants, 
2) site coordinator^., and 3) consuTting faculty members.* A tbrief. » • 
description of tffe characteristics of each of tl^ese groups is presented^ 
below. * . 

Description of Course Participants 
/' ' There were 293 participants enrolled in the DPRI course, 275 of | 
whom completed the course. The 'numbers of participants atN^ach site who 
enrolled and whd completed the course are presented in Table 1. . • 

The Confidential Background Questionnaire (CBO) was completed 
by each course participant (a copy of 'this instrument may be found in 
AESf? Technical Report'#4 Bramble, et^ §1, 1974, pp, 85)\ Participant 
characteristics, as i-nferred from the CBQ, are discussed in AESP Technical 
Report ifS (Bramble, Marion, and Ausness, 1975), To ^summarrze the 
characteristics of the participants , it may be s^id that they were female, 
elementary teachers, in their middle thirties , .who lived in rural areas^ 
They had an average of nine<years general teaching experience and seven ^ 
years experience in the teaching of reading. All of the participants 
held a baccalaureate degree and one-third X)f^hem were working on a 
master's degree, flost of them had taken undergraduate courses in reading, 
However, almost half had not previously taken any graduate level courses 
in reading. . , - 
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The 'site coordinator's d||ities consisted of 1 ) ^organizing the ^ 
classroom activities of the sjtude^ts, 2) monitoring the laboratory 
sessions, and 3) coordinating tfhei daily evaluation activities. The site 
coordinators also acted as a -1iai$on between the students "and the RCC. 
A fuM. description of the duties the site^ coordinator can be found in 
AESP Technical Report #2 (Ausness land Biowl ing, 1974), Descriptive 
^characteristics of the site coordinators are summarized in Table 2. ^ 

Degcrtption of Consulting Faculty Members - 

The duties of the consul tirig faculty members consisted of 
1) actiftg as a liaison between the RCC and cooperating universities, 
,2) consulting on program content, %) atting as a consultant for RESA[ ^ 
personnel and course participants, and 4) dbssfcrving and evaluating the' 
,in!^tructional programs. Each triangle had the services of one consulting 
faculty^member, making a total of five for the DPRI course. The five 
consulting faculty members were all highly qualified to ^suctessfully 
function in their roles as consultants and commentators for the CPRI 
course. ^ They each held a doctorate with * concentration in the field • 
,of elementary reading; they each ,held rank o^either associate or full 
professor in their^ respective colleges; and their experience in the 
teaching of reading varied from five to 18 years. The universities 
"•they represented an([l the sites they observed are listed below: 

Dr. Ruby Nell Cummings - Alabama A and M University, 

Huntsville, Ala. 

Dr. Les Van Gi^er - Appalachian State University, 

Boone, N.C. 



TABiE 2 



DESCRIPTIVE CHARACTERISTICS OF SITE COORDINATORS 



K Sex: Male 7 



Female 8 



. 4 



2. Highest Degree Completed*. Baccalauresite) 5 

'v / Master's- / 9 ^ 
' ' ' Doctorate / 1 



Site Coortffinators wiVh 
Work Ex^rieYice in: ./ 

Elementary teaching 
Jur>ior high teaching 
Undergraduate college teaching- 
Graduate college teaching . 
Elementary school principal 
Junior high ^priricipal 
Se^nior. high principal 
Counsel or ^ 



Frequency 



10 
9 
6 
5 
0 

J 

^^ 

2 



Median Years -'i 
Experience 

.,-4.5 , 
3.0 

^ 4.0 

' 2.5 

0 y 

' 1 .0 

s.p 

7.0 • 



' Courses Taken in Readying 
Instruction 



Undergraduate 
Graduate' 



Frequency 

7 
7 



Median Courses 
T^ken 

1 
2 



Experience in Tleaching 
Reading 



Frequency 
7 



Median Years 



12 
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Dr. John Taylor \^ 
Dr. Burl Breed! ove 
Dr. John C9nnelly 



- East Tennessee StaU University, 
LaFollette, Johnson ; City, Tenn. 



- \West Virginia Unji vej^sity, 

- Keyser, W.Va., McHejiry, Cumberland, Md, 

- State University College of New York, 
Fredooia, N.Y. 



ulting Faculty ^an 



A full description "of the duties of the Con 
be found In AESP Technical Report #2 (Ausness and B|)wlfing, 1974). 



* Procedures arid Instrumei^tation 

■ * 



Each, class day, began at 8:30 ^im EDT and end( d at-3:3b^m EDT, 
with an hour provided for lunch. * The participants attended class seven: 
times .and they viewed two programs and performed associated audio 
revjew and laboratory activities on most class days 
day the first activity consisted of Watchi.ng one vi 
coifipleting the. associated audio review. Then partic 
second video program and completed its associated au 
lunch the laboratory activities *associ-ated with each 
completed. ' Table 3 presents a schedule of when acti 



Pn a typ*icaV class' 
eo program and 
1 pants viewed the 
io review. After' 
f the programs were 
fities were under- 



taken. Seminars were shorn before the videotaped pnigram on days when 
jonly one videotaped program was scheduled; when two videotaped programs 
were scheduled the seminar was shown prior to the laljloratory activities. 

Evaluation procedures concerning attitudes tdward the DPRI coufse 
focused on the four major instructional activities u^ed in the course: 
the video lecture; four-channel audio review; the li\|e, interactive 
seminars; ^nd labioratory acti \/i ties, including infomi8|tion systems. 
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' ' 13 \ , • . . 

V ■. • TABLE 3 ' . . , * : 

PREPLANNEd SCHE^.LE OF .LEARjs(rNG ACTIUITI ES FOR D9RI COURSE 



Session 


Date 


Video Program 


• 

Audio Review' * 


•Seminar 


Laborato-ry 
Activity 


1 


Julyll 


- — 7 \ 

^^i', 2' ^ 


•1,2 




■ --l, 2. 


2 


July 18 


'3', 4* 
. . *. ■ • ■ 


' 3, 4 — • 




\3, 4 


3 


July 25 


5 


" 5^ ' - 


2- V. 


5 


4 • 


Aug X ' 




' ^ 6, 7 • ' 




6, 7 


■ ) 


Aug 8 . 


8, 9 




3 


■ S, 9 




Aug 15 


.10, 11 


' 10, '1-1 




10, 11 


: 7 ' 


Aug 22 




",.,12 . • 




12 ' 



♦Programs 3* and 4 wel'e broadcast on July . 25 due to, technical problems ' 
that prevented their .bei rig broadcast on July 18: • 



**Seminar 1 was canceled. " ■ 

Tab,le 4 lists the instruments used for -this report and gives a 
synopsis of the information contained in.:*hem.. -For more complete 
Information concerning the evaluation instruments, the reader is re- 
ferred to AESP Technical Report #4 (Bramble,' et al, 1974). 

The main' instrument used to measure attitudes concerning the 
televised lectures was the Televised Lectui4 Questionnaire (JLQ). This 
instrument was administered to the students at the end of every, televised 
lecture. The TLQ consisted of 27 five-point, Likert scale items 
concerning , tire quality of the televised lectures. , ^ 
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The predominant instrument used to m^sure attitudes toward the 
four-channel audio review was the User Four-Channel Audio Questionnaire 
(UFCA)*^ This instrument was. administe^^ at the end of . 

every four-channel audio review session, the UFCA consisted of 17 five- 

" ,^ • 

point; Likert scale items rating the sound, timing, mechanics, and 9 
content of the four-channel audio review. ' r - ^' 

^ Jhe major instrument used to In/asure attitudes concerning the live 
Seminars was the Seminar Questibnriatre (SQ). . this instrument was 



administered to^the studepts at the end of .each,sefni.r!feir. The SQ^'coYisisted 

of 21 five-point, Likert scale Items concerning the' qua! ity of the l.ive^ v^ 

\ ' ' . * ■ . 

seminar presentation. . . - ^ 

The Laboratory Activities Questionnaire (LAQ) w&s administered' - 
to the students at the completion of each laboratory session. The LAQ 
consisted^f 22 five-point, Likert scale items. „ 

student attitudes Concerning the Information Systems were ^ 
gathered on the Information System User Satisfaction Questionnaire 
{'ISUSQ).j^ The ISUSQ^ consisted of 25 five-point, Likert scale items, 
half of' whi ch Vfere concerned with the fexas Computer Retrieval System 
and the other half with the Select-Ed Informa'ti.on System. • ; 

For an Of the instrument? used, the five-point Likert scale - / 
was arranged as follows: ^ ' ^ 

Rate the statement as 5 if you strongly agree 

** * > ....'/,*.■■ 

4 if you moderately agree ^ 
' '3 if you feel neutral 

2^ if you moderately disagree ' 
1 if you strongly disagree / 



Each h the five instruments (TLQ, UFCA, SQ, LAQ.^and ISUSQ) was 
factor analyzed, and^ several different f'actor solutions were obtained for 
each' instrument. For the factoV analysis R^s were inserted on the diag- 
onals of j^Ke correlation matrices. Factors with eigenvalues greater 
than 1.^0 were retained and subjecied to VARIMA'X rotation. From, the 
final rotated factor loadings, items were selected to measure .tKe scales ' 
defined by each of the factors. J terns generally were retained for - 
' ^^measurement of the factor on which they loaded most heavily (± .30 was 

the cut off point for inclusion.on a factor). Where ambiguities occurred 
based on varying factor solutions, items were a^ssigned to factors based 
on the semantic content of the item.^ For each instrument the names of - 
the factors and the items included in the factor are presented In 
Table 5. For each program, factor means w^e computecf by averaging 
. across the item means that composed the factor. For each instrument 
" the results are discussed in terms of factor means, and item means 
for each instrument are presented in^Appendix B for those who want a 
more detailed picture of participant reactions. ^ ' , 

Information concerning each course activity was gathered from v 
the participants on the Instructor Feedback Questionnaire (IFQ). This 
instrument was administered after the^completlon of each third of the 
course (on July 25, August 8, and August? 22, 1974) in order to measure 
participant attitudes toward the major learning activities. The IFQ 
consisted of 9 five-point, Likert scale, items with space provided after 
each questiqn for written comments.' For the ratings, the participants 

were asked tp make their standarxl of reference an average, graduate 

_____ • ^ , t ■ 

educatTorTcourse and to follow the following guidelines: 
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Rate th|( statement as 5 outstanding 

3 average \ . 
' ^ :2 poor, \ 

^ . 1 unacceptable 

The Observation Log (OL) provided the site coordinators with -the 
opportunity to write comntents concerning the day's activities, as well 
as rate* various aspects of the 'DPRI course. The rating data were 
incomplete and are not reported. However^ the written cqmments from the - 
OL:are presented. ^ " . 

An overa;n evaluation of each of the fourjnain jnstructional 
activities, the unit tests and die evaluatign forms, was obtained at the 
conclusion of the <:ourse from the site coordinators ancl consulting 
faculty on the Summative ^R^ptf?^ Form (SR). This in^trumelit provided tli^m 
the opportunity, primarily through the writing of comments, to give /a 
summary of what they considered to be the uistifffrtive features of the. 
DPRI course, -it also allowed them thfe opportunity to make recommendations 
for course revision. / 

For each of tlie four main instructional activities, a selection ^ 
jOf the written . comments are'4ficluded. Jn each ca^se the comments were 
selected according to the following criteria: 1) include n^ative and 
positive^^-^etJimi^^ in proportion to the total distribution of comments 
received, and^) insure ^that' all majjbr complaints are included. ° ^ 



■ RESULTS 

This section contains a summarization of the data obtained from 
the rating instruments. Data are presented for each of the. major 
activities rated: pretaped video lecture, four-channel audio review, 
laboratory activities, and 1 ive seminars. Participant, $ite coordinator, 
and cooperating faculty reactions to the evaluation p^rocedures and rating 
scales, are also discussed. In the Method , section it was explained that fo 
the TLQ, UFCA, SQ, LAQ, and ISUS,Q a rating of 3 was to be given when the 
participant felt neutral toward a statement. After carefully comparing 
written comments with ratings on the instruments, it^as felt that 
.with a rating of 3 the participants were actually expressing , an attitude 
of being, neither positively nor negatively impressed with the activity 
being rated. Thus, mean ratings of 2.5 to 3.5 are interprete4 as "non 
impressed." The mean item range of 3.5 to 4. 5. is considered to be a 
moderately'^o strongly positive attitude and 1.5 to 2.5 is considered as 
a bLrongly to moderately negative attitude toward the aspect of the 
learning activity being considered. / ^ 

Videotaped Programs ^ . ^ 

FrOm the factor analysis of the Televised Lecture Questionnaire 
(TLQ), two factors were obtained: 1) television viewing conditions 
(high scores indicate favorable conditions) and 2) overall quality of* 
videotape. presentation "(high scores indicate high quality). The numbers 
of the items that make up each factor, as well as the factor means fd^ 
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^ ■ ^ • ■ * 

each program, are presented in Table 6. If the reader wishes to refers 
to the participants* ratings of individual items, item means and overall 
means are presented in Appendix B, Tab! 6^4. 

On the first factor, ^it may be concluded that the overall 

y ■ ' • 

television viewing conditions were favorable since all ^program^ means ^ 

from Table 6 were above or'near a four rating. Only programs five and 

. < 

six have means that are below four. j 

{ ^ 

Because the second factor was the student reaction to the overal 1 ' 
quality of the programs, it was decided to rank-order^the programs 
according to their factor means. Jhe*^ rankings are presented in Table 7. 

o . ■ • . 

Programs two, ten, and twelve are significantly above the grand 
mean, and programs five and^six ar-e significantly below, because the 
program means range from 4.01 to 4,54, it may be concluded that the 
overall quality of the video presentations was viewed by the participants 
as being moderately higK to high. 

Item two on the Instructor Feedback Questionnaire (IFQ) asked the 
participants to compare the video programs^wi th other live lectures the ' 
participants had seen (the means for the IFQ items are presented in 
Appendix B, Table B). The IFQ was administered three times during the 
course, and the means for item two were 3.47, 3.86, and 3.97. These ^ 
ratings are for programs one through five, six through nine, and ten 
through twelve, respectively. The first meaii of 3.47 represents a slightly 
positive overay rating of the video programs as compared to a live 
lecture. ^ The second mean (3.86) irrdicates a more positive reaction, and . 
the third mean of 3.97 is significantly higher (a = .10) than the firsts 

• \ 
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TABLE 7 



RANKING OF PROGRAMS BY FACTOR MEANS ON TELEVISED LECTURE qbESTIONNAIRE 

DPRI COURSE . 



Rank 


Mean 


, , Program Title 


Program Number • 


1 


. 4.54 


Vocabulary 




•10* 


2 


4.5l\ 


Informal Reading Test 




2* 


3 


4.45 ^ ' 


The Jotal Reading Program 
\ 

Comprehension 




12* 


4 


4.42^ 




11 


5 


4.39 


Reading Readiness and Beginning Reading/ 


8 


6 


4.37 


Word Recognition Tests 




4 


' 7 


4.34 


DPRI Management ^ ^ 




7 


8.5 




DPRI Introduction 




1 


8.5 


^.25.' 


Standardized Testes 






10 


4.18 


Word Recognition 


r 


9 


n 


: 4.05 

i 


Prescriptive Instructional Systems 




6* 


12 


i 4.01 

i 


Miscue Analysis 




5* 



*Signif icantly different from grand mean (GM = 4.31) at .05 level 

mean. The twelve programs can be divided into three categories based/ 
on content. Prograims one through five dealt with the diagnostic 
techniques used in reading instruction. Program six and seven dealt with 
information systems and classroom management techniques. Program eight 
through twelve dealt with techniques of. teaching reading skills. It 
appears that the participants were more^ attracted to programs that 
illustrated classroom practices than pro-ams that dealth with^ diagnosis, 
information systems* and classroom ^management. . 



Many comments made by participants on item 2 of the IF 
reflect these sentiments.* It seefms that participants really j 
preferred the televised lecture over the classroom lecture fo^ 
those programs dealing With classroom teaching techniqii?^. 

"It makes the lecture more interesting and exciting./ By 
using TV you cat) actually see things instead of jusi 
talking." ' 

In examining participants' preferences for a televised presentation of 

nly a portion of programs, one must look at program content versus 

methods of TV instruction. For example,- pertinent to this fliscussion is 

the fact that those programs rated highest were also those that are best 

presented vigually; i.e., the subject matter lends itself most easily to 

TV iristructiorir^.--^ 

"Precise, to the point, and actually seeing the different 
^techniques in use was extremel7 helpful." 

Not only was the content of programs 8-12 easily 'aidpatable to instructional 

TV, but the Vog^^si"^' content was less abstract and more famil iar to the 

participants than is the corttent of a program which deals with the 

explanation of the Reading lliscue Inventory. Therefore, when content 

was relatively simple- and f'amitiar to students, ^they seemed to favor the 

televised lecture format:^ 

"I really- enjoyed the TV lecture. The teletype helped to 
answer any questions and get answers right away." 



*(These comments were selected according to the criteria listed in 
the'Method section, and were chosen from all three administrations ■. 
of the IFQ.) • 
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. The ne^gatjive comments made by participants referred mainly to 
those program^ vjhich were more difficult to visually illustrate in an 
interesting manrter (i.e., classroom filn^-clips, etc.). For example 
the programs which dealt with diagnostic techniques relied largely upon 
on-camera lecture by the instructor, and relevant charts and diagrams. 
These programs necessarily came across as less interesting than others. 
Also, thej'cont^nt of these programs was more technical in nature and 
had to be dealt with; for the most part^ in general ities* The limitations 
of TV instruction and the time constraint both affected the depth of 
content that could be covered in each program. 



"r«^^t the lectures were too general if the course 
pajj^«ipant is not already familiar with DPRI procedures, 
^€^cially on 'the Reading Miscue Inventory." 

These negative comments were transferred or extended to reflect on the 

Students ' /feelings toward the instructor. For the more technical 

program^s, students indicated less enthusiasm in comparison to traditional, 

live lecture settings. , ' • 

"The TV program was related tQ^the subject but wasn't 
technical enouyli for the informatraq we had to learn 
from Our readings 

"Lhad rather have a good professor lectuy^ *in person 
than a TV program. 

It may be concluded from the pipeceding comments; that the aclfual program 
content was important in determining whether or not sl^udents preferred 
the videotaped programs or a live lectQre. . 

Coimtents by the site coordinators, from the Summative Report ^ 
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Form (SRh.are overall very favorable and express Tnany of the same 
oncerns as the participants' comments.. Regarding the trend of program 
reference discussea earlier, site coordinators responded as follows: 



26 



"Reading .st;9rted off with a good acceptance but ended with * * 

^ a much greater enthusiasm. The class applauded, some of 
the lessons /bjBgiiming with lesson 6. Participants were, 
especially gippreciative of the practical suggestions and 
help given fc^^ijinning with lesson 6." • ^ ' • 

^ ■ ""'^'^ ' - . ■ . V 

"The programs^^ot better as the summer progressed. You 
might need ti^^dfld. another pro.gram on the Reading Miscue >l> ^ 
Inventory." - . ^' * 

Further comments from. snte coordinators support the previous generalization 

^regarding the diffe<en<^s ii\ preference for certain programs because of 

. v ^ ■ • - ^ 

jdifferences in the nature of program content. ^ 

^ "The* lecture formai, was too dry. That portion of the program ^ 
dealing with visitations to schools for working models of 
DPRI approaches was^much^more favorably received." . ^ 

"Less talking face; hold graphics on the screen longer and 

bave them reproduced, in anofillary material i for reference. 

Have more demonstration of real situations for illustrating * ^ 

methods and techniques. In^general , the mterials were 

excellent." ? ' ^ . ^ - 

"These programs were exceptional and the onlvsiiggestion^ 
would be to cover less material and in-deptl/'^rarther than 
skimming so many areas." o - . ^ 

The most consistent unfavorable comments made by s4te coordinators 

concerned technical problems with the reception of video programs at 

some classroom -sites, - ^ ' 

"Throughout the course we had extreme audio difficulties. 
In spite of these, materials and concepts were well received 
by a very enthusiastic student group." ' / ^ . 

Voice was of poor qwality (technical) which made it difficult 
for the class to uriyerstand lecture.^ Color qQal ity was i 
inconsistent. " • . - ^ , 

The consulting faculty members were very ^sitive in their overall ' 

' ■ : r , V- 

ratings of the televised programs. They asked to rate the programs 

on a' 5-point scale (5 - excellent to 1 -"unac^ceptatfle) . Their average 

rating was 4.75. Their comments generally related to the pretaped 

programs within the framework of the complete course. 



"Loweirs sincerety and knowledge came through very well. 

. Wowl Outstanding! Relevant instructional and innovative 
reading techniques and materials presented by a talented . 
crew and instruGtop. , Demonstration classroom filming 

.and ecljting was outstantiing. The entire series of pV^ograms, 
course^'assignments, pre-prqgram preparations ancillary 
activities, follcw-up activi^ties with students and 1 ive 
seminars have provided our .RESA^ teachers with the ways and 
means of implementing a practical diagnostic and prescriptive 
reading approachx^in their classrooms." ^ 

"First 2 to 3 programs were, not received; that is, the 
quality of reception was. poor. After we started receiv>ing 
the prpatjams, they were excellent." , 

Most consulting faculty members, however, observed the programs on an 

■ ... , " . . 

irregular basis, as exemplified by the fol lowing comments: 

"Please was unable to see the reading seminars 

(except- the playback. of the one in which I participated). 
. However, I saw the majority of televised lectures, and would 
rate as above (rated this category 5, the* highest possible) 
for the lectures." , 

"Th€-4ectures that. I observed were usually excellent and 
the follow-up activities were related to the material 
discussed in the telecast." 

Consulting faculty members* cotnments about program content i^eferred 

mainly to the role of the site coordiqator. ^ Their comments .did not 

indicate dissatisfaction with program content; rather, it v/as felt tha 

the site coordinator should be used more as an on-site. .instructor * 

(though thisH^^ould largely defeat the purpose of the experiment). 

The^ consulting faculty sugge'^ted that sile coordinator^ should have 

adequate background in the subject. area to f|ll any void left by the 

program. . ' V / 

"I would recommend that site coordinators he (used) more ^ 
. than t\ey were during this program. I would recommej?^ that 
they be .people with a* background in the area* being taught 
^and that they bl& competent to extend and- expand ideas 
presented as their groups need such." 

■ ■ ' ' " «. 
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"The Reading Miscue Inventory was presented well; however, more 
time might fjave been spent in its utilization," 

V ' > ' ' 

•A final comment received was: ' ^ 

"Applicable to all activities, there need to be more 
opportunities for interaction among:^. the groups at sites 
and interaction w^ith those in the studio." • 



Four-Channel Audio Review * ^ ^ 

The factor analysis of ;the User Four-Channel Audio Questionnaire 
. (UFCA) identified five factors: 1 ) characteri^ics of sound (high rating 
"indicates adequa(%e sound), 2) time ano|j/ed for different aspe.cts of audio 
review: e.g. , putting on earphor^es, fmswering questions (high rating 
indicates sufficient time), 3) meathanics of presentation: e.g., speaker 



\ 



spoke clearly (high rating is adequate), 4) enjoyed using audio review 

/■-.-.•• • . ■ 

equipment (high rating indicates enjoyed), and 5) audio^ review content' 

(high rating is adequate). The factor means are presented in Table 8; 

for a more complete picture the reader may refer to the item means 

presented in Appendix B, Table C. , , ^^^>^ 

. ■ ■ , : ' - *\ . 

t »■ . " «• 

Prior to program six the audio review equipment was either not 
irts tailed or not operating well enough for data to be collected. At some 
sites the participants heard crosstalk, i.e., more than^bt^e cjiannel at 
the same time and sometimes the participants did not hear the channel 
they selected [see AESP Technical Repor]: #5 (Bramble, Aushess, and Freeman, 
.1975) for ajetailed discussion of the technical problems]. 'Only for the 
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fifth, factor (content) could data be coj^ected^ for alj programs. ^. This was 
possible because tlie participants were supplied with written scripis Jor 
use when the equipment waaZnot operational. - / 

■ ■ . • ' ■ ■■■ ■■ ■ . ■ / 

g\ ' '■ ■■ 
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^ . 

When the audio equipment was operational, generally from program 
six on,* the participant ratings (Table J) ranged from moderately' high 
to high for factors one through four. 'Exceptions to this are found for 
program six on factbir one^and programs six and seven on factor four, 
where si ightly positive ratings around 3.5 were obtained. Moderately high 
to high ratings were e btained for ::fact0^r five ( ' a. 

Item three'on the IFQ asked the participants to rate the audio 
review through comparison with "class quizzes followed, by class disscussicns 
of the answers" (Appendix B, Table B). The means for the' three adminis- 
trations of this item are 3.60, 3.57, and 3.53. The first mean (3.60) is 
tased on theparttcipants* reactions .to. reading the scripts; the last two 
means (3.57 and 3.53) are mainly base^ on the participants' reactions to 
actually using the^four-channel equipment: However,, several sites were 
unable to use the audio review equipment for some of the later programs 
(6-12), and their content ratings would be based on the written scripts 
in those instances. It may be concluded from .these. si ightly positive 
ratings that the participants were not nearly as impressed with the audiftj 
review (iiompared to class quizzes and subsequf»nt discussions), as ^^^^ 
were with the videotaped programs. - ^ 

Partici pants V res pbn^s to the questions asked during the audio 
review were to be recorded two^ways: 1) the responses were to be 
recorded on Op-sean sheets by £he participants, and 2) th^ alternatives 
selected via the -response buttons wer? to be automatically recorded on 
magnetic tape-. The 'equipment th^* was to automatically record and decode • ' 
the responses was engineered incorrectly and the data were lost. There-/ 
fore, the only availal(le data consists of participants' responses from 



the Op-scan 'sheets. These are summarized in Table 9. ' 

The proportion of participants that selected the correct alter- 
native ranged generally from .95 to 1.00. Exceptions to these are found 
on programs two, three, and five where the proportions for spme itenis 
range from .71 to .85. It may be concluded that the questions asked were 
extremely easy to answer. Thus the items served mostly to reinforce 
information already known by the participants. ^ " 

Participants' reactions to the audio review segments varied. The 
V selection of comments listed below [taken from the IFQ, item 3, (Appendix B, 
Table B)], indicates that some participants valued the audio review and 
the actual procedure used in the audio review as an aid and a reinforce- 
« ment for learning. \ * 

"Instant discussions of ianswers were good r^einforcers. as 
. learning aids." ^ _ \ 

. . "This' gives me a chance to test myself and* gives me a 

study sheet." • . • ' ^ v 

^' "^ Jike this approach. It gives you an idea of exactly 

what you have done and whether it was right or wrong and 
why." . - ' - , . ^ 

"You get a response right away and not in a couple of i^ys 

] with no explanation." , 

* " • . \, - . . ' 

The aydio review Questions were ifitendecl to convert concepts 

^ - ... ' ' s . . 

presented in the video into practical or situational-type problems or ; 

questions which might affect the participant as a teacher of readin^^. ' 

It may have been the use of practical , rather than very technical, 

questions that resulted- in the following comments by participants: 

"Answers were too easy. You 'cpuld choose correct ones . 
" • before questions were given." • ^ . 



V 



'."AnsweiP^seemed obvious before hearing the questions." / 
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TABLE 9 

AUDIO REVIEW QUESTIONS 
DPR I COUME 



Program 



Question 




Proportion Sel ecti ng 
V Alternative 



1 ' 



2 



1 

2 
3 
4 
5 



1 

2- 
3 
4 
5 



1 
2 
3 
4 



1 

2- 
3 

4 ' 



4 



.00 
.00 
.00 
.00 
.00 



.n 

'.00 
.01 
.00 
.02 



.01 
■ .00 
X03 
.00 
.00 



,01 
,00 
.00 
,02 



,.05 

,.22 

/.or 

.00 



1 .00* 
.01 
.98* 
.00 
.00 



.18 

.84* 

.00 

.00 

.00 



.11 

.01, 

.01 

.85* 

.01 



.01 

.00 • 

.02^ 

.97* 



.91* 
.01 
-.03 
..83* 



.00 
.'98* 
.01 
.99* 
1.00* 



.00 
.00 
.01 
.00 
.00 



Number 
of Students 



283 
283. 
283 
282 
281 




t .00 


.02 


i ..97*v j 


.01 ! 


268 


i .00 


.01 


i .06- j 


.93* 1 ■ 


267 


i ,95*- 


' .00 


': .01 # 


.04 1 


. 268 


; .99* 


.00- 


■" .00 i 


-.00 i , 


266 



ERIC 



*Correct, answer 
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" TA^LE -9 - CONTINUED . 





Question 

J— — -1 


Proportion Selficting 
N 1^1 ternative 


: ^- 

• 

Number 
OT Students 

• \ 


1 


' 2 


3 


4 


7 


1 


.01^ 


.02 


. 96* 


.00 , 


\ 
1270 




• 2 


.01 


.02 


.96* 


.02 


ZvO 




3 ' 


.00 


.99* 


.00 


.00 


Z/]0 




4 • ^ 


.00 


.99* 


.00 


.00 


270 


■ 8 


1 


.00 


.96*" 


.03 


.01 


257 . 




2 


.00 


.99* • 


.00 


.00 


25/ 






.96* 


.00 


.03 


:oi 


do/ 






.00 


:oo 


.00 

• 


1.00* 


do/ 




■ c ' 


1 


■ 


• 






9" , 




.00 ; 


" .92* 


.00 


:08^ 


262 




2 


-.01 1 


.97* ^ 


.01 


.01 


OCT 




3 


.01 i 


.99* 


.00 


.00 


cOc 




4 


.97* : 


.01 


.00 


.02 


OCT 


10 . . 


1 


.00 . 


.00 


1.00* 


.00 


265 




2 


.04 .00 


.01 


.95* 


doo 




3 


.96* • 


.04 


.00 


, .00 


cbo 




- 


.00 


.99* 


.01 


.00 . 


doo 


11 


° 1 


.00 . 


.00 


1.00* 


.00 


173 


2 


.04 


.00 


, .01 


.95* 


. 173 




3- 


.96* 


.04 


! .00 


.00 


' 173 




4 


.00 

-i 


.99* 


• .01 

i; 

i 


.00 


173- ' 


12 


1 


.00 


.99* 


1 . 

i' .00 


.00 


263 


2 


.00 


1 .00. 


1 .00. 


.99* 


263 




3 . 


.00 


. .00 


i .02 


.98* 


263 




4 

—S^ 


.00 

i 


1.00* 


! .00 

i 


.00 


263 



*Correct answer 
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"Choices of answers were poorly written." 

"The questions are good, but the use of the expensive ' - 
equipment is a waste orf time and money ." J) 

Other participants compared the four-channel audio revie\^ with learning 



ac^i^Cities employed in regular college-! ev'el courses. Some comments wer^: 

"A waste of tilne--most college courses are not quiz-oHfifnted. 
Could ayswer without even hearing question." . 

"The quiz seemed very elementary after doing the pre- 
proigram work and seeing the l^eptur^. " • 

A final comment reflected the difficulties experienced with the audio 

review equipment: ' • ' 

"To date, we have not had four-channel audio. Not connected. 
^ Used written form which was adequate. " 

Ttie bulk of site, coordinator comnfents (from the SR) regarding 

■ ^ ■ <% - * ' ^ 

the audio review dealt with equipment problems and dissatisfaction with 

the nature of the aud^io review questions; Sonje of these comments are 

1 isted below. 

"We were only able to have four-channel three times. The 
students thoroughly enjoyed it. Wish we could have gotten 
our equipment earlier." * ^ ^ 



"Students responded well to four-channel audio alVthe way 
through the/course." 

"After the cross-talk was corrected, it was good. Class 
^. felt there was too much time to make decision. Also no 
• need for preliminary instruction each time." 

"Here the format and timing was a. problem. Timing was too 
slow paced. Sometimes questions were too obvious." 

"Teachers were upset because the questions were too simple. 
They also disliked the equipment and fe^iled to see the 
purpose of the audio review." 



One site coordinator felt that the audio review would have been more 

effective if more questions were used: : 

"I think you may need to go to shorter questions and 
answers • . Why not have 15 questions instead of four?" 

The consulting faculty members were fairly positive in their 

overall ratings of the audio review. They were a-sked to rate the programs 

on a 5-point scale (5 - excellent to^-1 - unacceptable). Their average 

rating was 4.05. Their comments, listed below, reflect generally the same 

sentiments as those expressed on the preceding pages.. 

"This, segment seem^ to cause the most problems in the • 
programs which I observed. Students did not seem to 
respond especially ivell to this."" 

"Again, aftei;^ we received them regularly, they were very 
good," \ 

"One minute was .not needed to^ make response. You might*add 
three more ^questions. The written scripts 'saved' the foUr- 
channel audio component for programs 1-6. Alice should bg 
congratulated on a fine job-*thbse who have to- construct" 
test items know what ai difficult task it is.' VFor example, 
^ . on July 11, 1974, the students reading the four-channel 

audid script were all finished while the audio "tape was beginning 
beginning item #3. On program 11, five students ^ere on 
question #3 when the 1^5-second reminder was given for 
-question "'Note: Four-channel audio test items might ^ 
be numbered the same as program majtgrials, i .e. ,^FCA 2:1 , 
FCA 2:2, ^etc." 

"Need for a better coding system to match answer sheets with 
evaluation. Also, too much time 1apses\for correct response 
given by the narrator. " 

. - . In analyzing the preceding comments, one st^ould realize that the 

equipment malfunction during the first portion of the course and the 

■ ' ' f ■ ■ > .■ ^- \ 

difficulties experienced with the equipment once it was operational, may 

have colored both the participants' .and the .site coordinators ' views about 

■ ♦ • ' ■ ■ , 

the importance of the audio review a^ a learning act^'vity. The number 

. •: . • ' 43'- ' . ' 

V 
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of negative comments received reflected a substantial level of dissatis- 
faction vvitSiX-|J^^K?udio review questions, ansv^ers and equipment. "However, 



it should be; remembered that the overall ratings of the audio review ^ 
activities (from the IFQ) were positive. 

^Laboratory and Other Activities ' 

The factor analysis of the Laboratory Activities Questionnaire (LAQ) 
indicated five groupings of items that were descriptive of participants' 

reactions to\the laboratory activit'fes. The five factors were: 1) adequacy 

^• 

of time and facilities and appropriateness of amount of ma^terial covered 

' > ■ • ' ■ 0- [ ■ 

"during the laboratory (high ra^feing indicates adequate and appropriate); . 

2) tisefulness of laboratory as a hands-on illustration of lecture concepts 

(high rating is il lustra*4^) ; 3) usefulness and attractiveness of^e 

laboratory content to the participants (high rating is useful and" 

attractive content); 4) helpful ness of .the site coordinator (high rating 

is helpful); and 5) clarity of purpose and directions for performing ,the 

laboratory Jj>igh rating indicates clarity of purpose and directions). 

The factor means are presented in Table 10 and the item means are presented 

in Appendix B, Table' D. ' 

. J. , 

To aid in interpreting the LAQ dat^, each progjram was ranked from 

* *■ 

high to low on each factqr^ The rankings are presented rn Teble 11. To 
see if there was any consistency in the pr^ogram rankings across factors, 
Kendall's coefficient of concor-dance -was computed (Hayes & Winkler ,1971 , 
pp. 849-852). J\)e value obtained for W was .339. This value indicates a 
rather low degree of similarity in the ranking' across factors. 
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For each factor, program means that. were significantly different at the 
.05 level. from 'the grand factor mean are marked with.an asterisk (*) In 
Table 11. The laboratory activities" that were rated highest on one ^or more 
factors were 1, 3, 8, 9, 10, 11, and 12. Of 'these only 8',i^ 10, 11, and 
12 appear high on more than one' factor. The laboratory activities, that 
were rated lowest on one or more factors were 2, 3, 4, 5, 6, and 12. , 
Of these only 2, 5, and 6 appearUow on more than one factor.' Generally, 
"it may be concluded that the earlier laboratory activities <1 through 6) 
were viewed less positively than the later laboratory acti vi ties; J7 through 
12). This is roughly parallel to the results from the TLQ. It aplpears 
that the best rated TV programs are associated with the best rated v 
laboratory sessions (see Table 7 and Table 11 for comparison).- Also, it 
seems that the participants enjoyed the laboratories that dealt with 
teaching methods more than those that dealt with diagnostic techniques. 

rtem-four on the IFQ asked the -participants to compare the 
laboratory activitj'es with laboratory experiences they had in other • 
col l^ege courses. The means for the three administrations of this item 
are 3.81, 3.70, and 3.80. These ratings may be classified as moderately 
positive and indicate that the participants felt^that the DPRI laboratory 
activities could be firvorably compared to other courses. 

Completion of the laboratory activities required: 1) the' 
availability of computer-assisted information retrieval systems, and Jj/ 
the use of A reference 1 ibrary at each site which contained all materials 
referred to in the laboratory activities.' , 

• ■ 4 ■ > ■ •■ ■ 
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There were two information retrieval system? available to the 
participants,, Se1ect-Ed and the Texas Retrieval System, AESP Technical 
Report #2 (Ausness and Bowling, 1974, pp/ 20-^) gives a description of 
each system employed and states how each, was used by the participants. 
Briefly, though, to use either information system available, participants 
requestecl information searches by mailing a request form to the University 
of Kentucky. The search was run there and the information returned by 
mail. • ^ 

The reference library contained all materials^ books and test 
instruments necessary^fpr the participants to complete the laboratory'* 
activities. It also contained supplementary materials that expanded upon ^ 
the basic- program. * 

The Information Systems User Satisfaction /Questionnaire (ISUSQ) 

was factor analyzed and four factors were^ obtained, The factors arp: 

T) value of information obtained from information systems (^igh 'rating 

indicates high value); 2) information systems were useful as information 

sources (high rating is useful); 3) adequacy of explanation a^ ease of 

use of information systems (hiph rating is adequate); and 4) turn around 

time in receiving information (high rating indicates acceptable length 

■ - - . , \ i 

of time). : The factor means are presented ipf/Table 12 and the item mearis 

are presented in Appendix B, Table E. The participants" ratings on 

factors two Sr\d three were moderately positive. Thus they felt that the\ 

information systems were useful --as sources of infoonattoa, that the 

procedures foV use'^were' explained adequately and that they were' easy to^ 

4. ■ • ■ 

use. Factor one has a mean of 3.31, and it appears that the participants 
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TABLE 12 



FACTOR* MISRNS. FOR INFORMATIOXSYSTEMS USEBrSATIJFACTION QUESTIONNAIRE 
Ih-^ y (M=236) 



Factor 



Items on' Factor 



Factor Mean 



1) -Value of information obtained 

from informatior systehis 

2) Information systems were use- 
ful as information sources 

3) Adequacy of explanation and 
ea s e of us e of i nf ormati on , 
systems 

4) Lengthy of time to get 
information back . 



7-lX), 13-18 
f 

20-25 



1-4, 11, 12 
5, 6 



3.31 
4.08 

3. -^9 
3.05 



were unimpressed wrth the informa.tian they got from the informjition 
systems. Fin ally, on factor^our the mean is 3.^15, and apparently the 
participants were not impressed with the speed of receiving information 
back from the information systems. ° - * 

Item Six on the IFQ asked-the participants to compare the 
information systems to materials supplied ih other courses. The means for 
the three administrations are all towards the positive (3.81, 3.91, 3575) 
and indicate that the^ participants were favorably disposed towards tiTr-N 

information systems. 

Item five on the IFQ asked the participants to compare the on- 
site reference materfals with materials provided in other courses. The 
means for, this item are very positive (4.10, 4.00, 4.08) and indicate ■ 
that the participants were pleased with the on-site materials provided.. 
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Two"final assets of the course related to^ the laboratory activ- 
ities were rated by the participants. These were pre-program preparation 
'Compared to work assigned in other^courses and homework assignments 
compared to other',classes. The pre-program preparations were usually 
readings to be c(^mpleted prior to class. Participants reactions to this 
were measiired by item one on the IFQ, ,The means (3.72, 3.58, 3.79) 
M*nd1cate a low .positive reaction to the pre-^pr/gram preparation. Item 8 
^ on the I FQ dealt with homework. The means for this item (3.61, 3.58, 
3.76) tend toward a mildly positive reaction. 

Participants were asked to comment on the? fivte^ items on the IFQ 
which dealt with the laboratory and associated activities. In gen^re^l, 
students seemed to be most favorably impressed with the following: 
' 1) opportunities for small group dl'scusslons in. class ; 

2) access to reference and'Vesource materials via the 
on-site reference library; and 

3) the or^nization and completeness of the laboratory 
materials. ^ • »J ^ 

Listed below is a selection of comments made by the. pajhtici pants for 
each of the five items. 

Item 4 - Laboratory Activities ' . 

"Th£ last sessions seemed like busy work when so much 
material is available for readiness, etc. Discussing 
them, in the laboratory Would be sufficient. " 

"Very good - unique opportunity With small class for 
discussion of problems and solutions. Received new 
Ideas and materials." 

"instructions not always clearl No one to clarify them." 
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"Sometimes redundant, Sequentiallx - ill -timed." 
"Interaction with other students good," 



Item 6 - Information Retrieval Systems 

"We never got feedback from the retrieval system. It's 
gdod/fto know about it, but, it wasn't any practical use to 
us, ' 

-"Didf-not receive complete set of materials. Materials 
^ i; ' . a>«i 1 able were excel lent, '- 



J.tem 0 - On-site Reference Library 

f, 

"Having all materials available (in reference library) 
was very helpful,. Many times reserve materials are not 
obtainable," / ' 

* • . * , ' 

"For one lesson we were not equipped with the material. 
Receiving material to read at-home has helped ^since it 
^ ^is so hard to get to a university to do (libray^y) research, 

"The materials were always here. There is no waiting in 
line to get one certain book then finding sqmeone has torn 
oqt the Vticle you^need^'' ' 

"More materials than I can use profitably," 

"I think I would have circled 5 on this, but I didn't 
get much of a chance to look at the materials there was 
so much going on all the time. Too much" work both in 
class and out. There -was not time to do any in-depth 
personal exploration,". 

"You don't have to wait anpl end up doing it only when ySu 
can get the material," 

"Have liked checking, material s out and using them." 

Item 1 - Pre-Prbgram Preparation 

"The materials are meeti 
than any graduate cou#e I have taken," 



'The materials are meeting the needs of the students better 
:han any graduate couiS^ 

'^"Work required is too exterysive for one class day's 
preparation. However, th^^materials are well -organized 
and thorough." ' ■ 
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"In some instances there js too much when pre-^program 
preparation is combined with follow-up from previous 
programs." , 

. ' . ^1 

"I hive pMt more time in preparation for this course ju^t 
doing thejessentials , therefore, I have received moire."^^; 

"Too much to -cover adequately . You end up skimming much; 
of the material ." 

"It prepared me well for the classes though^ it was too 
muGvh work. " - - 



■Item 8 - Homework Assignments , 

.\"Often unclear and too much to cover "adeqSfately. No one 
to answer questions." 

"You got to put to use what you\ acquired in class." 
"Good - BUT - too long - detailed." 
"Homework assignments generally adequate preparation." 
'"Too much with meager guidance." ' 

Comments by tfie site coordinators, froirf'the Summative Report - 

Form, (SR), are overal>very favorable and express mSmy of the same concerns 

as the participants' comments. The site coordinators felt that the content 

of the activities and materials was excellent, but that there was too much 

outside work required of participants. Some comments received are listed 

below, , ; ■ ^ ^ i 

/'Generally, the activi'ties were very meaningful but on ^ 
'occasion there was not enough time to complete everything." 

"Stucfents seemed to get a Tot out of lab work. They- did j 
complain about a lot of outside reading necessary for the 
course . " 

"There appeared to be an imbalance in the amount of outside ^ 
work required and the time allotted. The participants did, ' . 
however, indicate that it was valuable work. Some directions 
* were weak and iTnclear." 
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"Lab activities were a great experience for the students. 
However, the common complaint was the weight of assignments. 
The sei^ies of assignments dealing with testing a student 
.seemed- to drag down a number of the 'teachers." 

"Students definitely felt activities were, \$forthwhile and 
important to learning process. "• 
if ■ , . ^ • • 

* "They were unanimous--the practice sessions, in administering 
the standardized tests were very helpful.^ Also, in sharing 
materials for completing lab activities we divided into small 
groups,, studied separate materials, and then reported to the 
group. As a result, all related- reading materials were used." ^ 
. • • ** . 

The consulting faculty members were\very 'positive in their over- 
all ratings of the laboratory and related acti^vities. vThey were as4<ed to 
rate the. programs on a 5-point scale (5 - excellent to 1-- unacceptable). 
Their average rating was 4.60. Their eoiw^nts generally emphasized the 
course workload mentioned eahdier by the participants and site- coordinatons 
/"Excel'ftRnt and related ^) other activitiesi;^^" - 

r \ - • * , . , ^ • • 

. . '^"Only gpmplaint was 'too much' from students. Everything 
was meanin^ul and purposeful, therefore, worthwhile. " 

"All Were meaningful to students and consul ting^^^farulty. 
The jA/ell -prepared .laboratory activities and information 
systems provided for the immediate needs of the neophyte 
. classroom teg(cher and the experienced reading specialist..." 

"Actually too much/laboratory work for the'course. However^ 
• a quick student coulid pace herself . Suggestion: have more 
time slots to have group interchange of ideas, comments, 
etc. Perhaps involving more on-campus, (or local ) re'ading 
people." ^ . 

An examination of . the "comments from all three groups—participants, 
site coordinators and consulting facul.ty--indicates that, although the 
course organization and corj^fent were referred to as excellent, the heavy 
v/orkload, botif in and out of class, 6verwhelined some of the participants. 
Together with the imposed time constraints during glass, sessions, this 
could have made some lab activitites seem less meaningful than they might 
have seemed otherwise. . . i 
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Interacti ve Senii nars 

The original plan for the DP^course ca^jled for four seminars^ 
but due to a transmission failure the first seminaNr was not broadcast 
The Seminar Questionnaire (SQ) was factor analyzed alod six factors were 
ob^ined* The factor means are presented il^J■ab^e 13 ffrvd—fehe item^means 
are presented in Appendix B, Table F. * .) ; P , ■ 



TABLE 13 ' 

FACTOR MEANS ON SEMINAR QUESTIONNAIRE. 
■ DPRI COURSE 



Factor 



Seminar 



Items on Factor, 



3 ■ ^1 



1) , Quality of presentation style of 
seminar - 



3) Adequate opportunity to ask 
^ questions ' \ 

4) Important questions, were- asked 
by participants 

" -'A 

,5) Proper time in course sequence 
for seminar 

6) Adequate pretaped segments 
used in seminar 



2, 7-12,' 19, 20, .3.76 i 3.90 



"2) Value of information communicated ! 13-16, 8^ 
during seminar 



03 1. 2. 76 



4.22| 

I 

■ ■ f 

3.1l' 



3„ 5, 6, 15 



4 

17 ^ 
1, 21 



. : 4*04 ! 4.09"; 4.2 



3.07 
\ 2.85 

I 

! 2.86- 



3.22 3.35 

;2/95 

■3.83 



3-. 15 



♦None used in seminar 3. 
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Factor one deals. with the quality of the seminar presentation. 
Generally the participants felt that the quality was moderately high and 
that the quality improved as the course progressed. This is seen in the 
gradual increase in the factor means across seminars: 3.76, 3.90, and 4.22 

Factor two deal^s^with -the value of the information compiunicated 
during the Seminars. That participants were unimpressed with the value 
of this information is indicated by the mean ratings of^3.03,* 2.76, and 

Factors three and^four are related in that factor three deals with 
the adequacy of opportunity to ask questions of the semijjar^^^^ 
factor four deals with whether or not important questijeiris were asked by 
the participants. The participants felt that they had adequate opportunity 
to ask questions (as reflected in means of 4.04, 4.09, 4.21) but that^ 
important questions were perhaps not asked (as reflected in means of' 
3.07v,*3.22, 3.35). , Systematic records of the questions received fr/m the 
Students were not always kept, but some data are available to il/ustrate 
t\\e patterns' of question-asking behavior. For seminar one 75 questions 
were received; about half of these were answered over the air during the 
seminar (the remaining questions were answered, either by voice or tele- 
type VHF. transmissions after the seminar broadcjast) . For seminar three 
35 questions were received, alT of which were answered durin^the senn^ 

Factor fiv„e dealt with whether or not each seminar was broadcast 
at an appropriate J;imS in the course sequence. For all three seminars, 
the. participants' mean ratings (2.85, 2.95, 3.15) indicate that the time 
was not highly appropriate. ^This needs to be interpreted with the knowledg 
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that the first scheduled sertiinar wa^s canceled and that the first broad- , 
casyt seminar had to cover topics from the canceled seminar in addition 
to the scheduled seminar. However, one^does wonder when the studenis 
might consider seminars to be appropriate*. 

During the first two seminars, filmed senments were shown that ^ 
illustrated some aspects of the topics with which the seminar dealt. 
Factor six includes the participants' reactions to the adequacy of thes^ 
filmed segments. The mean ratings for this factor indicate an uninijjr^ssed 
and a positive response (2.86 and 3.83). . 

On item seyen of the IFQ, participants were asked to .compare the 

televised seminars with seminars and class discussions from other classes. 

The means for . the three administrations of this item a^e 3.40, 3.44 and 

3.59, which indicate that the participants were Slightly positive towards 

seminars in comparison with seminars and class discussions from 

other courses. However, one advantagous feature of the televised seminar 

which was commented on by several participants was the opportunity to 

Interact with reading experts. One such conorient was as follows: 

"Very good, practical and useful material from expert 
consultants. Emphasized available materials and their 
■ o usages. " 

The most frequently stated negative comment was that the capacity 

for interaction between students and seminar guest(s) was not used enough. 

Some comments are listed below. * 

"Not enough interaction and direct, feeback and cross- 
questioning." , ' 

"Boring. Prefer live, by far." 

"Last program best because more participants and more ' » 

questions submitted." ^ ' ^ 
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As stated previously extensive technical probi ems ( interrupted the planned 
sequence for the seminars; however, had all four planned seminars been 

broadcast, the participant reaction would likely have been more positive.. 

I ■ ^ <- ♦ ' 

Comments by the site coordinators, from the Summative Report 

r 

Form (SR), are very favorable overalVand express many of the same 

concerns as the participants/ cormnents. The site coordinators fel t that 

the program content was excellent, but that there was too much redundancy 

and not enough time allotted for questions and answers. 

_ ■ ■ ■ ' , ■• t * ' ' 

"Seminars, although generally of good content, were dull 
and boring. Students very often lost interest because of 
redundancy." ^ . 

."The televised seminars did not aljow ftfr m^ny questions 
to be answered,^ ^ 

"Need panel members with a greater amount of time devoted 
to specific questions, rather than having authorities 
enlarge on the materials in the ^telecast. " 

"We were only able to vi-ew the last two seminars and^ the 
only suggestion is that they omit the taped portions. 

Teachers redlly enjoy just listening to Dr. Eberwein." 

■i ■ • 

One site monitoV commented that a better method of soliciting questions 

might have increased student participation 'during the palling sessions: 

"Ke§p answers short and make sure the questiions are answered . 
directly and to the point, e.g., when a question that requests 
only a yes or no answer is asked, the' tendency has been to 
circumv^ent the question instead of giving a yes or no^and 
then qualifications. ^Perhaps a 'better structure and method 
of soliciting questions needs to be developed. It is 
-difficult to poll questions from teachers before or during 
a seminar because this tends to be disruptive ta other * ^ 
questions." 

The consulting faculty members, were very positive in their overall 
ratings of^ the televised seminars. They were asked to rate the i^grams 
on a 5-point scale (5*- excellent to 1 - unacc^table) . Their average 



ERIC 



' 5Q , ' 

ranting was 4.60. Since many of the consulting faculty members were un- 
able to view most of the seminars, their comments mainly -emphasized the 
interactive capacities of the televised seminars. Most were iiiipre^ed 
with the fact that participants were able to interact with various experts. 
ir)/thG field of reading. Some of their comments were: 

"I was impressed with the quality of the questio.ns. and the 
responses given by the seminar .experts." 

"These were excel lent--students liked the personal attention 
and 'immediate' reinforcement of seminars." 



"Need more of -these. " 
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"These ratings (highest possible) reflect my disciissibfi with 
the teacher-students since I was unable to attend (due to 
heavy teaching load). As mentioned on item onej I rate the 
lecture in which" I partic^ipated as 5 (highest on this scale), 
with some FTiodesty. I have heard that the last reading , 
seminar was the best (from a number of people vyho saw itXj." 



Reactions to Evaluation Materials 

The Summative Report Form (SR) asked both* si to coordinators and 
consulting facul ty members to comment on the evaluation forms utilized 
in the course. 

Although their comments varied^, the general consensus was that 

there were too many forms used in the evaluation of each class session. 

For this reason, students soon felt that completing the evaluation forms 

was a tedious, boring task and tended to Tiose sight of the purpose of the 

evaluations. Some specific comments made b^ site coordinators follow: 

\ "Absolutely to6 many forms to fill out." 

"The construction of the forms was excellent, but the teachers 
soon got Vired of doing them; there were too many forms, and 
part?icipants felt that UK put^more emphasis on these forms , 
than on the subject conterlt." 

' 0^)1 J) 



"Too much evaluation. Some resentment oyer evaluating each 
bft and morsel each day." 

"Teachers recognize the need for these forms, but could do 
without them. Generally, their attitude has been excellent." 

VThe evaluation methods were easily acceptable.. Even witi? 
the large volume of materials to evaluate" each session, the 
students always responded positively arrd favorably." 

"There was unnecessary paper wasted. Each student could be 
given one set of all forms at the beginning of the course 
whichxould be referred to each day. Also, a 'does not 
apply ' choice should be^ a response as many of the quest-ions' 
did not pertain to particular programs." 

"Too damn many forms. 'Suggest only one form per broadcast. 
However, I ranked these 5 and ranked 5 for content and 
qual.ity (5 was high rating on SR) becauss^they were excellent; 
there were too many of them to fill out ^every ^day. " 

"They accepted this most agreeably, sirrce they understood . 
that it was of , value to you; the few who complained learned 
to 'live with it.' On the last day, they left full of 
enthusiasm. It was amazing to hear them talk.. It was 
unanimous that this course was the most yalui^^le reading 
course any of them had e\Ler had. The teachers made this 
- statement oyjer and over -to the superintendent. Because 
of this, the spring course at this site is futl and others 
hoping to take "jt. ,Do hope it's basically the same." 

"I doubt if they were valuable as evaluation tools; after 
the first week or two most participants resented them, 
and I did them sloppily. Many times participants wouldv 
forget if #1 was positive or negative and I did not care." 

The consulting faculty members were very positive in their over-^ 

all ratings of the evaluation forms. They were asked to rate the forms 

on a 5~point scale (5 - excellent to 1 - unacceptable). Their average 

rating w?is 4.40. Thejr comments generally emphasized the need to reduce 

the number of evaluation instruments used in each class session. Too» 

several comments suggested that some changes be made in the organization 

of test instruments used. Some comments, were: \ 
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"St:udents seemed to think there were too many forms/and ^ 
tha\ they were too complicated." 

"As cited earlier, the forms could have had a better system 
of coding for answer sheets. Suggestion: color-coded j 
plus symbols " . - / 

As consulting faculty, I did not have an opportunity to 
examine the evaluation forms. The forms seeme«a to be ^ 
too extensive. Some students filled in the blanks without 
much thought after the 'Second program. I question the 
validity of some o^ the data collected. Sugg^estiori: not ^ 
so many (forms) next time. Congratulations on a fine job."^ 
i» . » 

Reactions to Unit Tests . • 

At th^ beginning of each class session the participants Were given . 

short unit tests. These were multiple choice tests of from 12 or 13^ items 

that sampled the content from -the last week's, video.. programs and laboratory 

activities.- The unit tests did not affect the participants' grades. 

[For a discussion of the purpose and development of the unit tests see 

AESP Tephnical Report #4 (BrambVe, et al, 197.4, pp. 5-9)]. Rather, these 

tests were used as an instructional aid and as an evaluation toul to 

measure unit learning. The participants discussed their answers in class 

after they had turned in their answer stieets to the site coordinator, 

[For a discussion of participant performance on the umt tests see 

AESP Technical Report #8 (Bramble, Marion, and Ausness, 1975)]. 

Item 9 on the IFQ asked the participant's to compare the unit 

tests to instructor-made tests in other graduateclasses they hadtaker. 

• The mfeans for the three administration, of "fhe °IFQ ^e 3.82, .3.59 and 3.88. 

From this it may be concluded that the participants were mildly positive 

V-/ . 

toward the unit tests. /^ 
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Item 9 on the IFQ also asked for participant comments on the unit 

tests*. Selected cjbmments, listed below,, convey that most participants 

valued the t^Sts^as learning or instructional aids because they 

received Hmmedi ate feeclback*' on the correctness or incorrectness of their 

answers. However ,,^the participants complained that the learning process 

stopped here, inith^t students were unable to obt^ feedback on why ap 

answer was wrong or rlgh^. Some of the. more frequently received cprtiments 

were as follbws: ' ' ^ 

"I need more feedback on thfe answers -as sometimes f don't ^ 
understand orNagree with your choice." 

"All graduate courses seem to have ambiguous questiofis. 
This is no exception." ^ ' ^ ^ 

"On. many questions, we disagreed wi|th you, but again could • 
not question or . discuss it with you I" ^ 

"-Nice again to have these to rfefer to." 

"Liked this type of repetition to make information stick." 

"At times we disagreed with answers posted; however, 
there was no way to confirm or dispute unresolved questions. 
So, nothing new learned." " ^ ^ 

"The tests seemed comprehensive enough to opver all 
materials." 

/'It keeps you up-to-date, I don't completely agree with 
'.the answer given as compated to my , answers on the unit 
^ ' tests." ^ ■ ^ 

Generally, the site coordinator's nomments reflected similar 

concerns and observations. This selection of comments is taken from 




the SR. 



"These were often a challenge and the studisnts enjoyed 
discussion. Some of the "^tems were ambiguous, making 
selection of a response subjective." 
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J, "Often, students disagreed with'the given answers and^did 
not receive a response wh6n we submitted these questions." 

"Quite a few teachers who disagreed with some of the answers 
on unit tests and seemed to have evidence to back up their 
arguments." / . ' 

"The- unit tests served^ as a valuable reinforcement for the 
program." - ' 

"Students have always responded well- to the unit tests. The 
opportunity to check the work immediately after completion 
•was a good reinforcement approach. A number of students 
. questioned some answers listed; these questions were sent to 
UK via the collection box, but replies were never received. 
Students needed and should have received clarification." 

It is interesting to note the final two comments made by si.te coordinators 

"These tests could have had more meaning to the teachers if 
they had' counted toward. their grade." 

"Students found them helpfuV in recall of important facts. 

Perhaps the i<iea that they were ^not counted toward their 

grade made ^em more useful I" ■ ^ . 
* * * 

The consulting faculty members were also asked on the SR to rate' 

the unit tests. Their average rating was very positive, 4.55 on a scale 

from 1 to 5 (5 - excellent to 1 - unacceptable). Some comments and 

observations jnade by the consulting faculty were: 

"Questions tended to be the 'answer and forget' type 
rather than the 'think about afterwards' typ%. Suggest 
. activities related to exparyding ideas in questions." 

"I felt that many students {and myself also) thought the 
unit tests were rather easy, by and< large." 

"Consulting faculty did not have the opportunity to read the 
questions. I only had the opportunity to read the ones 
Students disagreed with. I did feel that the items were 
reasonable considering the amount of time you had tp 
develop them without field testing. The students complained 
(legitimately) about eight items. Eight out of 129 is an 
excellent recctrd I It might help faculty to get feedback 
and questions from Kentucky to help students having 
difficulty with specific items." 



Summary of Site Coordinator Comments from the Observation Log 

The Observation Log (OL) contained spaces on which site^ 
coordinators could log any problems, comments, etc. observed during the 
class session. A synopsis of these comments is included here so that ttie 
reader can get an impression of the day-to-day problems and reactions, 
that" were recorde^ on the OL. Since the OL was filled oilt at each of the 
15 sites, it must be remembered that the commen^ below reflect Anly the 
opinions of those who chose to write' comments . The following, comments^ 
are listed chronologically, by class sessions, and are divided into five 
categories: equipment, video content, lab materials, evaluation, and 
general . / 

. -v ^ *' Session 1 - July 11 , 1974 ' - ^ 

Equipment: One site reported not receiving any television and Htod 
inoperable telephone and telegraph equipment. Two sites reported that 
channels 1 and 2 of four-channel audio review equipment were inoperable. 
^ Video Content: One site reportisd that the initial reaction to the/course 
was excellent. 

Lab Materials: One site reported that the students felt that there was 
too much lab-" activity scheduled. Another site reported that the students 
"seemed unable or unwilling" tp^ take the initiative of performing. the 
laboratory activities without a great deal of assistance. And a third 
site reported that the teachers felt that the laboratory activities would 
be useful . j 

Evaluation: One site reported that the students were "overwhelmedVwith 
the amount of paper work required of them. Another site reported that 
the^students generally found ^the evaluation forms confus.ing. 
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Session 2 - July 18," 1974 

Equipment: Networl!; problems prevented broadcast from being transmitted. 
Video Content: One site reporte<i that the students felt that they could 
use the content to improve their reading programs in the fall. 
Ev.aluation: Two sites reported that the students had questions concerning 
the correct answer of questions 6 and 11 of Unit Test 2. Another site 
further reported that the students were growing to dislike all evaluation 
forms. ' 
General : Orf^ site reported that the students would like to have their 
questions answered either during the seminar or by return mail. 

Session 3 - July 25,^.974 , 

Equipment: Three sites found the audio to be poor, having a constant 
"hum. Two sites reported to have- generally poor reception in this date. 
Two other sites reported cross-talk in the four-chann^ audio review 
equipment. . 

Lab Materials: One site reported that the lab materials were acceptable 
in relationship to other unit activities. ^ 
Evaluation: One site found that the evaluation materials were packaged • 
improperly. Another site reported that the class felt that there were 
too many forms to (fill out. 

General : One site requested that there should be no, teletype activity 
during TV presentation since it interfered with hearing the program. 
(The teletype unit was in the classroom). 



/ 



57 ^ / 

Session 4 - August 1 , 1974 . / 

Equipment: One site reported that for the first program of the day the 
audio was off 3/4 of the time, and two sites repor'ted that the audio 
was greatly distorted for program #6. Another site reported cross-talk 
on the four-channel audio review equipment. r ' 

General : One site reported that the pacing of the four-channel audio 
review questions was too slow and that the questions were too simple. 
Another site reported that instead of using the "four-chanpel audio review 
equipment, they simply discussed the content bf the four-channel script. 
This activity was said to be preferred by ^he students. 

^ ^ Session 5 - August 8, 1974 

Equipment: One site reported that the master cojitrol for the four- 
channel audio' review unit was still malfunctioning, th'at cross-tal k -was 
still prevalent, and that the encoder was not triggered by the control 
unit. Another site reported that the broadcast quality was excellent, 
while a third, site, reported that the sound was not clear on the programs. 
Evaluation: One site reported that the evaluation procedures are becoming 
a chore for the students and that many s*tudents disagreed with some 
answers on the unit tests. . — 

' General : One site reported' that the students disliked both the four- 



channeV aucKQ^ review questions and their mode of presentati 
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Session 6^ August J5, 1974 

' ' r ■ ■ . ■ ■ ■ . 

' Equipment: Two sites reported the technical, qua! ity of video and audio 
presentation to be quite poor, and one^'site reported static in the audio 
for the 2nd program of tke day. * 

Evaluation: One site reported .that the students disliked both the four- 
channel audio review questions and their mode of presentat^^on. 

Session 7 -^August 22, 1974 

Equipment: One site reported that the class enjoyed the seminar and 
foilind the seminar^ests to be quit^ informative. 

Lab Materials: One site reported t^jat the students disliked the laboratory 

' I ' 

ax:tivity since it was similar to the assignment done in w^ek 7. 



CONCLUSIONS 



\ 



The following is a summary of conclusions regarding *|artioi pants' 
ttitudes toward DPRI course activities. 



Videotaped programs in the latter half of the course (programs 
8-12) were thought to be better than those' in the first half 

of the course. Therefore, it appears that the participants 

• ■ ■ . ■ ■ ' _ tf 

were more ^attracted to programs that illustrated classroom 
practices than programs that dealt with diagnosis, informat^ion 

systems and classroom managements 

*. ■ ■ . . ■ 

Program con^nt appears to be the factpr that determined whether 
or not the videotaped programs were preferred-^over the typical 
campus lecture. " . . - / 



The immediate feedback nature of the four-channel audio review 
was the best liked feature^ of that activity. 

Overall, the audio review ratings were/positive; however, it 
was felt by many participants that the "^estions were too easy' 
and were often unrelated to the video program. 

The later laboratory activities (sessions 7 through 12) were 
viewed more positively than the earlier laboratory activities 
(sessions 1 through 6); it appears that the best TV programs ^ 

are^associated with* the best-rated laboratory sessions.. 

s . 

^ • " 59 



Laboratory activities and materials that dealt with teaching' 
methods were more enjoyable than those that dealt with dia^nosti. 
techniques. ' / . ' » \ 

Participants felt that the two information systems. Select Ed 
and the Texas Retrieval System, were useful as sources of . 

o 

information, that the procedures- for^^use were explained- 
adequately and that they were easy to use; / 7 



Participants were favorable toward the use of information 

systems but felt that the utility of such systems could be* 
. . , , , . , ,1; 

increased by improving turnaround time on seaV^ches tm-^ 

The on-site reference materials were felt to be complete and 
very useful . 

The value of the live, interactive seminars seemed to lie 
in the ability to interact with ".expertfi'V in the field of 
diagnostic and prescriptive reading. 



The/participants felt that they had adequate opportunity 
to ask questions but that important questions were per- 
haps not asked. Too, it was felt that much of the material 
discussed during the seminars was redundant. 

The evaluation design included too*many forms. Revision 
/of the design to include fewer administrations of less^forms 
/was suggested. 
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In extrapolating from the foregoing conclusions, the reader should 
kqep in mind that certain extraneous and unexpetted variables, such as 
equipment malfunctions, influenced the evaluation data gathered for many 
aspects of the course. Further, although 'various evaluation instruments, • 
such as, the Observation Log, attempted to account for these variables by 
providing space for a written description or explanation of special 
problems, it is very difficult to ascertain either'how many areas of the 
course were affected or the extent to which participants' and site 
coordinators' attitudes were affected. Too, since "hindsight" is always 
better than forsight, oifr experience in the total course development arid 
operation heis indicated several areas which could be improved upon from 
the standpoint of pre-planning. 

In the following" commentary, the authors of this report and , 
others involved 'in the course reflect on problems of this nature and 
offer suggestions, should the course be offered again • 

As stated previously, equipment malfunctions generated a great ^ 
deal of frustration for both participants and site coordinators. For 
"example, the four-channel audio review was never really functional in' 
the designed manner so conclusions as to the usefulness_ of this system 
can-bg only tentative at this time. However, the need for competent 
equipment 'design and installation cannot be overly stressed.. 

Another problem-area concerned the role of the site coordinator. 
It seems that many participants misunderstood the site coordinator's 
fairly passive role, that of monitoring course activities. Instead, 
many. participants expected the site coordinator to serve as instructor 
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* rather than as a faciUtator. From many informal contacts with the site 
coord iriators, it ap^^ars that they were not completely confident about 
their role of operating all the equipment and guiding the laboratory 
sessions- Although a one-week, pre-course workshop was held for the site 
coordinators prior to the course, it isC^felt by many that this was., in- 
sufficient time in which to train them to be efficient coordinators of 
a complex course- They Suggested that a more carefully designed pre-^ * 
course instruction for site coordinators be planned to assist them in 
itiSre effectively fulfilling their roles. 

Regarding the class sessions, one recurring comment received from 
the participants on the IFQ and from the site coordinators on the 'SR was 
that there was too much to see and do eath day- The participants often 
did not like the amount of work that was expectpd from them in terms of 
pre-program preparation, laboratory sessions and^homework. Perhaps some 
of the work load could be cut so that these activities would support only 
the key i^fsues of the video programs and not try to 'expand upon them. A 
recommendation (nade was to have more class meetings and do less at^each 
meeting- 

With regard to the videotaped programs the reader will' recall 
that the data from the TLQ (Table 7) indicated that the four lowest- 
rated programs were programs 3, 5, 6 apd 9. These data were compared with 
comments made by Paul LeVeque, producer-director of the DPRI TV programs. 

It was his feeling, based on a production/technical viewpoint, 
that programs three (Standardized Tests), six (Prescriptive Instructional 
Systems), and nine (Word Recognition) contained content that was hard to, 
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visualize in an exciting and attention-holding manner (see Appendix A, 
Item A). He also felt that while program five (Miscue Analysis) contained 
much new and complex material, its low rating (see Table 7) was due in 
part to the loss of the seminar that.was to follow the broadcast of 
program five (see Table 3). The seminar was to further explain the use 
of the Miscue Ana1j4sis,<'and the program was insufficient without the 
seminar^ 

Mr. LeVeque offered some suggestions as to why some programs 

were rated high. Programs two (Informal Tests) , eight' (Reading Readiness 

and Beginning Reading), ten (Vocabulary)^^ eleven (Comprehension), and 

■ \ . * ^ 
twelve (The Total Reading Program) contained practical, useful information; 

and, the infor^riation presented contained many classroom film segments 

showing Appalachian teachers at work. He felt that the teachers in the 

DPRI course found applied topics that were illustrated with classroom 

scenes to be the most^ irrterestihg. . 




... 
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• APPENDIX A 

Item A 

DPRI Course Content and 'Objectives 

The topics and objectives for each of the tvi/elve programs are: 

PROGRAM 1 - DPRI INTRODUCTION . ~^ • 

I. Identify reading sub-skills 

II. Identify the parts of the diagnostic-prescriptive reading 
instruction model 

III. Realize the importance of early diagnosis and correction of reading 
problems 



PROGRAM^.- INFORMAL READING TESTS 

I. Recognize the advantage of informal reading tests 

II. Interpret the results of informal reading tests 

III. Identify the sequence of activities involved in constructing 
an informal reading inventory 

The Potter and Rae book, Informal Reading Diagnosis , will be used. 

PROGRAM 3 - STANDARDIZED TESTS 

I. Identify the procedures necessary for>effecti ve administration of 
standardized tests 

II. Interpret the results of standardized tests . 

III. Recognize the strengths and limitations of standardized tests 

The Stanford Achievement Test , Primary I and II ?ind the Murphy- 
DurreTI Reading Readiness Analysis will be used. 
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PROGRAM 4 - WORD RECOGNITION lESJS 



66 



I. Interpret the results of the Wisconsin Design for Reading Skill 
Development : Word Attack 

II. Connect diagnosis to the instructional materials 

III.- Identify the the "sequence of activities involved in going through' 
a complete test^teach-test instructional cycle using the WDRSD: WA 

The Wisconsin Design for Reading Skill Development : Morxl Attack 
- will be used 

PROGRAM 5 - MISCUE ANALYSIS ■ / 

^ 1. ' Identify and do the sequence of activities involved in administering 
the reading miscue inventory ' 

II. Categorize reading miscues ' * 

III. Compile the results of the reading miscue inventory on coding sheet 

The Reading Miscue Inventory will be used 

PROGRAM 6 - PRESCRIPTIVE INSTRUCTIONAL SYSTEMS 

I. Translate test results into words (descriptors) that can be used 
to find materials in the retrieval systems 

T. Identify the sequence of steps in the process of materials selection 

III. Determine which ^kill descriptors are most appropriate for each student 
IV. Recognize the strengths and limitations of different retrieval systems 

• ■ The Select Ed and the Texas Retrieval Systems will be used 
■ . 

PROGRAM 7 - DPRI MANAGEMENT 

I. Identify several, patterns of grouping 

II. Assess tl?e sti^engths and limitations of grouping patterns 

III. Determine the most appropriate grouping pattern in a given situation 
IV. Recognize reasons for using a grouping pattern fn a given situation 
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-J- PROGRAM 8 - READING READINESS AND BEGINNING READING ^- 

I. Identify activities used to teach reading readiness and beginning 
reading 

II. List advantages and disadvantages of the activities 

^ III. Determine which activity is most appropriate for a given situation 
The Teaching of Reading^ will serve as a resource for programs 8-11 

PROGRAM 9 - WORD RECOGNITION . '^V 

• I. Identify activities used to teach word identification ^ 

II. List advantages and disadvantages of the activities 

III. Determine which activity is most appropriate for a given situation 

^ ■ ' 

PROGRAM 10 - VOCABULARY . 

I. Identify activities used to teach vocctbulary 

II. Lis?t advantages and disadvantages of the activities 

III. Determine which activity is most appropriate for a given situation 

■ * 

fROGRAM 11 - COMPREHENSION 

" * ■ 

I, Identi'fy question strategies used to teach comprehension 

II. Write questions to stimulate student responses in various categories 
(i.e. knowledge, translation, etc. ) 

Ill^^^i^termine the most appropriate question strategy for a given situation 

PROGRAM 12 - THE TOTAL READING PROGRAM 

I. Identify ways to encourage parental participation in reading programs 

II. Determine ways to integrate trade and library books in diagnostic- 
prescriptive reading instruction 

III. Recognize the strengths and limitations of DPRI 

IV. Determine ways to implement diagnostic-prescriptive reading 
instruction in a total reading program 
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Item B 



The Pre-Program Preparation, Laboratory (Ancillary) Activities and^ 



PROGRAM 1 - DPRI INTRODUCTION 
I. Pre-program Preparation 

A, None 
II? Ancillary Activities 
A. Materials needed 



1. Example list of problems 
B. Activities 

1. List problems you have in teaching reading 
III. Follow-up Activities 
Pjjt A. None 

PROGRAM 2 - INFORMAL READING TESTS 

I. Pre-program Preparation for Program 2, Informal Reading Tests 
^e^ Materials needed 

1 . Informal Reading Diagnosis , Potter and Rae 

2. How to Judge Readability of Books , Tape Transcript 

3. tiow to Judge Readability of Bo "ol<s", Student's Workbook 

4 . "Creating Questions for Informal Readtng Inventories" 

5. "Question Strategies for Teaching Reading as Reasoning" 

6. Informal Reading Inventory, sample by Rizk 

7. Interest Inventory i 

8. The Teaching of Reading, Dallman 

9. Pre-program Generalization Sheet 

B. Activities 



1 . Read Informal Reading Diagnosis 

2. Read How to Judge. ReadabilUy of Books, Tape Transcript 

3. Read How to Judge Readability of Book s, Student's Workbook 

4. Read "Creating Questions for Informal Reading Inventories"^ 

5. ReadjlOuestion Strategies for Teaching Reading as Reasoning' 



Follow-up Activities for each DPRI Program 
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.6. Read the Informal Reading Inverttory, sample by Rizk 

7. Read the Interest Inve,ntory 

8. Optional: Read Chapters 1 and-2 in The Teaching of Reading 

9. Complete Pre-program Generalization Sheet 

II. Ancillary Activities . 

^ A. Ma'terials needed - ^ 

1. Informal Reading Diagnosis . Potter and Rae * 

2. How to Judge Readability of Booi^s . Tape Transcript 

3. HovJ to Judge Readability of Books . Student's Workbook 
4*. "Creating Questions for Informal Reading Inventories" 

' 5. "Question Strategies for Teaching Reading as Reasoning" 

6. "Informal Reading Tests" , 

7. Informal Reading Inventory, sample by Rizk. 

8. Interest Inventory • . 

B. Activities . 

O ' ... 

1 . Construct an Informal Reading Inventory 

2. Construct an Informal Test for diagnosing a skill 

III. Follow-up Activities 

A. Materials needed ; * 

1. Irr fon n dl R Ea:ding- Inventory ^ 

2. IRI Record Sheet ^ 

3. Inforn/al Skill Jest ^ , ^ 

B. Activities - 

1. Administer Formal Reading Inventbry to elementary student 

2. Administer Informal Skill Test to elementary student 

PROGRAM 3 - STANDARDIZED TESTS _ • 

I. Pre-prOgram Preparation 
A. Materials needed 

1. Murphv-Durell Reading Readiness Analysis . (MDRRA) Specimen Set 

2. Stanford Achievement Test Level I (SAT-I) Specimen Set 

3. Stanford Achievement Test Level II (SAT-I I) Specimen Set 

4. Pre-program Generalization Sheet 
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B. Activit% , ^ 

, s 

1. Read the Administrator's Manual for MDRRA and the 
Accompanying s-tudent test booklet 

2. Read the Administrator's Manual for SAT-I and II, and 
accompanying student test booklets 

3. Read Norms Booklets for SAT-I ahd II 

4. Complete Pre-program Generalization Sheet 

II, Ancillary Activities " 

A. Materials needed 

1. Murphy-Durrell Reading Readiness Analysis (MDRRA) 
. . Specimen Set 

2. Stanford Achievement Test, Reading Tests , (SAT-I) 
Level I , Specimen Set 

3. Stanford Achievement Test, Reading Tests , (SAT-II) 
Lev>l II , Specimen Set 

B. Activities ^ 

■^^ 1. Administer either MDRRA or SATRT to partner 

2. Complete score tables for MDRRA ^ind SATRT I and II 

* - . ■ 

I'll, Follow-up Activities 

A. Materials needed • ,r * 

1. MDRRA or SAT-I or SAT-II 

2. Read "Measurement Terms For Classroom Teachers" 
^ 3. Read "A Glossary of Measurement Terms" 



PROGRAM 4 - WORD RECOGNITIOJ^ T^STS 
I. Pre-program Preparation 

A. Materials needed < " 

1. Teacher's Planning Guide ;^Word Attack, Wisconsin^ 
Design for Reading Skill DevelopmenT " 

2. Test Administrators' Manuals, Levels A, B,X, D ; 
Wisconsin Tests of Reading Skill Development 

3. Test Booklets, Levels A, B, C, D; Wisconsin Tests of 
Reading Skill Develolpment; Word Attack 

4. Pre-progjtam Generalization Sheet 
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B, Activities 



1 , Read the Teacher's Planning Guide; Word Attack > 
Wisconsin Design \ 

2, Read >the Adtninistratdr 's Manual s > Levels A, B, C, D; 
Wiscorr^in Design; Word AttacR" • // 

3- Read the Test Booklets, Levels A, B, C, D; Wisconsin 

Design; Word Attack . . - 

4. Complete Pre-program Generalization Sheet^ 

II, Ancillary Activities 

' A, Materials needed . /• /. . ^ 

1 • The Wisconsin Design for Reading Skill Development: 

lAlord Attack (WDRSD: WA). Specimen^ Set plus Manual 
2, Skill Development Guidelines; Levels A, B, C, D 

Activities ^ * ; • 

• 1. Read Guideline for appropriate level 

Test-teach-test classroom partner using WDRSD: WA 

III/ Follow-up Activities 

A, Materials needed ' . 

* 1 • WDRSD: WA 
Activities > 
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1. Adnrinister WDRSD: WA to elementary (K-3) student 

2. ' Outline appropriate material s you would use to teach a skill 



PROGRAM 5 - MISCUE ANALYSIS " ^ 

Pre-program Preparation . 

A, Materials needed . 

1. Reading Miscue Inventory Manual , Goodman and Burke 

2. The Teaching of Reading > Dallman 

3. Pre-program* General ization Sheet 

B, Activities - 

1. Read the# Reading Miscue Inventory Manual 

2. Ogtionaf: Read Chapters 3. 9A. 9B in The Teaching of 
Reading 

3. Complete Pre-prqgram Generalization Sheet 
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IL Ancillary Activities 
A, Materials needed 

1 , The Wisconsin Design for Reading Skill Development: Word 
. Attack (WDRSD: WA), Specimen Set plus Manual 

2. Skill Development Guidelines; Levels A, B, C, D 

« B. Activities . ' i ' 

1. Read Guideline for appropriate level 

2. Test-teach-test classroom partner using WDRSD: WA ^ 
IIL Follow-up Activities 

A. Materials needed^ 
1 . WDRSD: WA ' ' \ 

B. ^tivities . . 



1. Administer WDRSD:' WA to e1ementa\y (K-3) stiKlent f 
- 2. Outline appropri ate*" material s you would use/to teach 
• a skm 

J ■ 

PROGRAM 5 - READING MISCUE 
I. Pre-program Preparation ^ ^ 

A, Materials needed ^ 

1 , Reading Miscue Inventory Manual , Goodmein and Burke 
2- The Teaching of Reading . Dallme^ - 
3/ Pre-program General ization Sheet 

B, 1 • Read the Reading Miscue Inventory Manual- 

' 2, Optional: Reerd Chapters 3, 9A. 9B in The Teaching of 
. , ^ Reading 

3, Complete Pre-program Generalization Sheet ; 

II. -^Ancill-ary. Activities • ' 

A. Mat^riafs needed / * 

. I 'T , Reading Miscue Inventory Manual 

- 1. 2. Blank Selection Worksheet 

^ / 3- Guideline Selection Worksheet 

4, Retelling Outline . . ' 
- 5- . Guideline Retelling Outline , 

6. Blank Coding Sheet 
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7. Guideline Coding Sheet \ 

8.. Synopsis of coding sheet answers 

9. Blank reader profile . • 

10. Guideline reader profile 

B/ Activities / 

1. Listen to tape and mark selection worksheet 

2. Listen to tape and mark retel 1 ing outl ine 

3. Complete coding sheet ' 

4. Complete reader profile . ^ 

III. Follow-up Activities (Optional) 

A. Materials needed 

1. Selection Worksheet (student constructed) 

2. Retelling Outline 

3. Coding Sheet 
'4- Reader Profile 

B. Activities 

' _ K Make selection worksheet 

2. Complete retel 1 ing outl ine for your selection 

3. Administer your RMI to elementary- student 
4* Code and profile results ' 

■ ^ ■ 

PROGRAM 6 - PRESCRIPTIVE INSTRUCTIONAL SYSTEMS 

■/ . ■ ■ . 

I. Pre-program Preparation 

A. Materials needed 

1. The Teaching af Reading . Dal Iman 

2. Thesaurus, Select .Ed ■ 

3. Thesaurus. Texas 'Retrieval 

4^ Pre-program Generalization Sheet 

B. Activities 

1. Read Chapter 17 in The Teaching of Reading 

2. Read Thesaurus. Select Ed 

3. Read Thesaurus. Texas Retrieval 

4. Complete- Pre-program General Ization. Sheet 

: - ' • . -A 
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II. Anc i 1 1 a ry Ac t i v i t i e s 
A. I Materials needed 



III, 



1 . 
2. 
3. 
4. 
5. 
6. 
7. 
8. 



Description of PMRS 
Six case studies 
Thesaurus -Select Ed 
Thesaurus-Texas Retrieval 



System 



Sample Synthesis Form for Wayne 
Sample RetrievaT Request Form for Wayne 
Synthesis Forms (2) 
Retrieval Request Forms (2) 



B. Activities 

< . • ■ _ * . 

1. Read Description of PMRS 

2. Translate test results from two case studies into descriptors 
and that can be used to find materials in the retrieval systems 

I 3. Compare your retrieval selections with those' provided 



Test result^ forjyour student 
Thesaurus -Select Ed 
Thesaurus-Texas Retrieval System 
Retrieval Request Forms 



Follow-up Activities 
A. Materials needed 



1 . 
2. 
3. 
4. 



B. Activities 

1. Translate test results for your elementary student into' 
< \descriptors that can be used ,to find materials in the 

retrieval systems 

2. Make out a request form like Wayne*s and give to site 
/ coordi/iator to send to the RCC ^ 



PROGRAM 7 - DPRI MANAGEMENT 
I. Pre-program Preparation 
A. Materials needed 



ERIC 



1. The Teaching of Reading , Dallman . ' ^ 

2. Pre-program General ization Sheet 

3. Example independent activity 

B.. Activities . ^ 

1.. Read ehapter 13 in The Teaching of Reading ^' 

2. Complete Pre-program Generalization Sheet 

3. f^^^pare an independent activity to share wtth class, 

^-'^ ' • J^^^ ■ ■ • ' 



/ 



JI. Ancillary Activities 



^. Materials needed 



1. Your handout of an independent activity 



B. Activities " 

1. Discuss one of the five decision making questions with 
your partner 

2. Dtscuss with the class the advantages and disadvantages 
of the various grouping patterns ^ 

3., Discuss with the class independent activities which can 
' ' be used while you are working with a group and then 

exchange handouts 

III. Fpllbw-up Activities 

* A. Materials needed 

. 1. Description of Sinclairvil le reading program 
- 2. Example "My Grouping Pattern Problem" 

B. Activities ^ • . 

^ 1. Read the description of the'Sinclairvil le reading ^program 
^ 2. Briefly describe .the class you had this past school year ' 
and show how you grouped them for instruction. Then ^ 
make Suggestions on how you would change your grouping 
patterns if you had tite same group next year. 



f^ROGRAM 8 - READINESS AND BEGINNING INSTRUCTION 

I. Pre-program Preparation ^ 

A. Materials needed ^ ' 

1./ the. Teaching of Reading , Oallman 
i. Pre-?p.rogram Generalization Shfeet 
3. Example activity for readiness and beginning reading 



B. Activities 




1. Read Chapters-4A a^id 4B iq The Teaching of Reading 

2. Complete Pre-piaef^afe^^ Sheet. 

3. Prepate handout of liechnique used for teaching a 
readiness and begjnriing, reading aotivity 
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II. Ancillary Activities 

A. Materials needed - \^ 

1. Your handout of activity for teaching'a readiness or 
V beginfiing reading skill / 

B. Activities - 

1. The five class members 'for Program 8 reposrt on their ^ ^ 
activities r \ 

2. Class members exchange their handouts , , ' 

III. Follow-up Activities 
^A. Materials needed 

1. Suggested activities by classmates 

2. Example summary of readiness .activity 

B. Activities 

1. Read the suggested activities ^ 

2. Do one of the readiness activities with your K-3 stiident 
and write brief summary of the strengths and weaknesses 
of the skill activity- ^ 



PROGRAM 9.- WORD RECOGNITION STRATEGIES 
I. Pre-program Preparation 
A. Materials* needed ■ 



.> 1. \Th6 Teaching of Reading , Dallman 

2. Pre-program General ization Sheet 

3. ^ Example activity for word recognition skill / V ^ 

' \ ' ' • ' . 

Bi. Activities ' 

Read Chapters 5A; 5B^ and 15 in The Teaching o.f Reading 
■ ' 2. Complete Pre-program Generalization Sheejjk ^ : - 
''3. Prepare handoht of technique used for teaching a^word 
recognition skill 



n. Ancillary Activities ' 

A. Materials needed 

^ : / [^\] Your handout t)f activity fo^ teaching a word 
- \^ r. recognition skill 



4 
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B. Activities ^ <0 

1. Discuss in class the advantages and disadvantages of 
these five approaches to word recognition: phonics, 
gaming,* patterning, Distar, and FernaTd ^ 

2. The five class members fov Program 9 report on their 
activities"" v 

3. Class members exj&harf^e handouts * ; 

III. Follow-up Activities. 

A. Materials needed ' 

1. Suggested activities by classmates 

2. Suggested games by Montgomery 

3. * Fernald Approach summary • 

4. ^ Example summary of word recognition activity 

B. Activities 

1. Read the<5&uggested activities - 

2. R§ad the suggested games by -Montgomery 
' 3. Read the Fernald^ Approach summary ^ . 

/ 4. Do one of the word recognition activities with your 
K-3 student and write brief summary-reaction of the 
skin activity 

PROGRAM 10 - VOCABULARY 
J. Pre-program Preparation 

A. M2fteria1s needed 

1. "Activities for Increasing Hearing and Speaking 
Vocabularies," Wise ' » 

2. "Stimulate Reading With a Dictionary," Miller , 

3. "Vocabulary Development in The Primary Grades," Bougere 
^ 4. Pre-proglram'Genera1ization Sheet 

5. Example activity for vocabulary skill 

B. Activities 

, ' \ 

1. Read "Activities for Increasing Hearing and Speaking 
Vocabularies" . ^ 

2. Read "Stimulate Reading With a Dictionary" 

3. Read "Vocabulary Development in The Primary Grades" • 

4. Complete Pre-program Generalization Sheet 
.5. Prepare handout of techniques used for teaching vocabulary 
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11.^ Andnary Activities 

A. Materials needed 

1. Your handout of an activity for teaching vocabulary 

B. Activities 

1. The five class members for Program 10 rfeport on their 
activities * 

2. Class members exchange their handouts 

III. Follow-up Activities 

A. Materials needed ' ^ 

1. Suggested activities by classmates 
2.. Example summary of vocabulary activity 

B. Activities 

1. Read the suggested activities ^ 

2. Do one of the vocabulary activities with your K-3 
student and write brief summary 

PROGRAM 11 - COMPREHENSION 
. I. Pre-program Pfep^aration ^ ^ 

A. Materials needed ' . 

1. "Question Strategies for Teaching Reading As Reasoning" 
Eberwein (See Program 2, Ancillary Materials) o - 

2. The Teaching of Reading , Dallman • 

3. Pre-program Generalization Sheet 

4. Example activity for comprehension skill 

B. Activities 

\. Reread "Question Strategies for Teaching Reading As 

Reasoning". Choose short passage and develop comprehension 
questions. ^ « 

2. Read Chapters 6A and 6B in The Teaching of Reading 

3. Complete Pre-program General izatiory Sheet 

4. Prepare handout of technique used TO 
comprehension skill C J. 



\ 

ERlC ■■ 



• ■ ■ ■ ^ ■ * 

II. Ancillary Activities 

A. Materials needed 

I. Your comprehension passage and questions 
2;. Your handout of an activity for teaching comprehension 

* 

B. Activities 

1. Read partnerls comprehension passage and questions and 
write brief critique of the questions 

2. The five class members for Program report on theiV' 
activity 

3. Class members exchange their handouts 
III. Follow-up Activities ^ 

• *. 

A. Materials needed 

1/ Suggested activities by classmates 
2. Summary of activity for comprehension 

B. Activities 

1. Read the suggested activities 

2. Do one of the comprehension activities with your K-3 
student and write a brief summary-reaction of a ski^l 
activity ' . 

PROGRAM 12 -THE TOTAL READING PROGRAM 
I. Pre-p[rogram Preparation 

A. Materials needed 

1. The Teaching of Reading , Dallman 

2. "Parent Assists to the School Reading Program" 

3. Pre-program Generalization Sheet 

B. Activities 

1, Read Chapters 16 and 17 in The Teaching of R'eading 
.. 2. Read "Paren'C^ Assists to the School Reading Program" 
. 3. Complete Pre-program Generalization Sheetf 



80 

II.' Ancniary Activities ^ . 

A. Ma^terials needed 

1. How I Would Change My Reading Program, example 

B. Activities 

1. Write a short report describing your reading program 

last year,^ and alternatives for teaching reading this year. 

III. Follow-up Activities ^ 

A. I^one 



5;S 
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APPENDIX B _ 

Appendix B contains tables of Item means for all of the instruments 
reported on in the text. In each table, individual items and a paraphrasing 
of the item wordings are included; On the actual instruments some of the 
items were phrased liegativeT-y. In the tables, the phrasing of the items 
has been changed and the means. have been reversed to allow for the correct 
interpretation of the ratings. In the colons of these tables are the v>*~ 
DPRI programs. The item means are in the body of the tables. The means 
were obtained by averaging over the number of individuals who responded to 
each item. /For each table, except Tables C and E, statisticaV tests were 
run to determine which program means for each item were significantly 
higher or lower than the other program means. For Tables A and D contrasts 
were computed that compared one mean against the combined mean for the 
remaining means on that item. For Table B, t-tests on successive pairs 
for each item were run. For Table F, Tukey - HSD tests on successive 
pairs of means wer^ run for each item. 
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TABLE B ■ . •' 

ITEM MEANS AND STANDARD DEVIATIONS FOR IFQ: DRPI COURSE 



Item 




Program Numbers 






1 - 5 
&"Sem'1 


6 - 9 
& Sem 2 


10 - 12 
& Sem 3 


• 0 

1. Pre-Program preparation compared 
to/work assigned in other 
graduate classes 


Mean 
s.d. 

N 


3.72 
.86 
184 


3.58 
, .92" 
233 


3.79 
. 96 ' 
252 


2. . TV Program compared to a 
graduate lecture 


Mean 
s.d. 


Q A lie 

1.10 
158 


O . oD 

.91 

233 


Q Q7* 

.95 

252 


3. Four-Cbanne1 Audio compared to 
class quizzes followed by a 
discussion of the answers 


Mean 
s.d. 

. N - 


A fin 
1.12 
143. 


1.19 

233 


3 51 
1 .23 
252 


4. Laboratory activities compared 
to laboratory activities in 
other graduate classes 


Mean 
s.d. , 


7 PI 

.89^ 
181 


.89 
233 


.97 

252 


5. On-site /eference material s 
compared to materials placed on 
' re,Serve by other graduate. . ^ 
• instructors , ' . 


M^a'on 
s.d. . 

^N ■ 


4 . 1 U 

- \ 94 
181 


4 . UU 
.90 
233 


A HQ 

.90 ■ 

252 . 


6. Retrieval systems materials - 
. compared jto materials used to 
help stuti^nts * ' ^ 


Mean . 
s.d. 

■ ,N 


3.81 

. 92 ; 
142 


. 3.91 
- .95 
J 91 


3.75 

1;23 
' 222 


7. jTelevisedj "jntfiractive seminars ^ 
' ^ "c ompar ed\t^b graduate seminars 
and class disucssions- . 


Mean 
s.,d . 

N 


3.40 
T.05 ' 
113 


. 3.44\ 
1 .02 ^ 

.198 


^ 3.59 
, 1.10 
.222 - 


8. Homework ass-ignmehts compared ' , 
to other gra^duate classtes \ 


Mean-. 
s>d. - 


3.61 
.99 

~ 165 


•3.58 

.99..- 
192 


3.76 ■ 
1.11 

222 


9. V Unit tests^eompared ,to instruc- 
^ tot njade Jte'st^ In other graduate 
classes J ^ ' / 

wa— ^ , .* 


Mean 
s-.d. 
N • 


-3.8^ 
.81 
165- 


1.59 ■ 
.94- 
1-93 


3.88 " " 
. .'93 -. 
222 



*t-tpst^be|>ween these two mgsns v5as ].57, thisM's significant at, .10 

i^vei. . 



Note: 5-point Likert sCale J = .unacceptable 5 '= oufst'Sinding ' 
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TABLE E , 

MEAN RATINGS ON ISUSQ: DPRI COURSE 
(N=236) 



Item ^ 






Mean 




~~ z — 







1. The Select-Ed training package adequately explained the 

use of this information system. , ^ 4.11 

2. The Texas Computer Retrieval System ti^ining package 

adequately expTained the use of this information system. ' 3.9Q 

3. I feel that' the information request form for the Select- 
Ed information was , clear in itsformat. 4.l1 

4. I feel- that the information request form for the Texas 
Computer 'Retrieval System information was clear in its 

format. ' 3.87 

^ - . . ■ 

5. I feel that it did not take too long to receive information 

from the Select-Ed system. 3.09 

6- L feel that it did not \ake too long to receive information 
from the Texas Computer Retrieval System. 

7. The Select-Ed information search provided me with the^ 
information I wanted. * 3.35 

8. The Texas Computer Retrieval System information search 

provided me with the information I. wanted. ' • ^3.30 

9. The Select-Ed information system gave me more information 

than I expected. 2.97 

10. The Texas Computer Retrieval SJ^stem information system 

gave me Jipre ir>formation than I expected. k '^'^^ 

11. The Select-Ed information system was easy to use. 3.80 

12. The Texas Computer Retrieval System information system 

was easy to use. ' 3.57, 

13. The information received from the Select-Ed information . 

. ^ system was easy to interpret. ' ' ' 3.34 

14. The information received from the Texas Computer Retrieval' 
System information system was easy to interpret. 3.28 



35 



88, yV 



TABLE E -- CONTINUED 



{ 



Item . * ^ . , Mean 



16. The Select-Ed information system provided- me with useful 

information. - 3.44 

16. ^he Texas Computer Retrieval System provided me with 

useful information, v , ^ 3,36 

17. The Select-Ed information system is well worth. the time 

and effort it took to use it. ^ " 3.51 

^ ^./■ • \ , 

18. The Texas Computer Retrieval System information' system'is 

well worth the time and effort it took to ^use it, r 3.45 

'19. I received conflicting information front the different 

information systems. ^ ^ . * 2.72 

20. If the Select-Ed information system were available to me, 

in my school system, I would use it. ■ 4.35 

21. If the Texas Computer Retrie.yaT System tnformation system 

were available to me, » in my school system, I would use it. 4.16 

22. I feel that the Select-Ed information system js extremely 

; vbeneftcial. to me as a teacher. ' 4;07 

23. - I feef that the Texas Computer Retrieval System information ^ 

systenKjs^ extremely benefi^al to me as a teacher. ' \^ 3.86 

2^. I would recommend the Select-Ed information system to my 

. bellow teachers. ^ ' . . 4.13 

25. I would recommend the Te5(as Computer Retrieval Sys'tem ' 

i nformat Ton , system to my fellow teachers. " ■ ' ■ ^ - 3,91 

> Mean for Se1ect-El^ ' . " ^ ' ■ ? ' ' 3.69" 

'Mean for Texas ■Computer Retrieval System " ' „ 3.ZG 

' . ° • ° - ■ • ' ■ ■ • ■ / . 

Note:. BTpoint Likert scale 1 = strongly disagree v- 5 s^fapsQjigly agree 



TABLE F 



MEAN RATINGS ON SQ: DPRI COURSE 



T f Pin 


\ - ' 


N 

1 
1 




7, 
> 


Overa.1 1 

1 LciM 

Mean • 


'1. 


Pretaped films valuable supplement 
to course material . 


.2,3 
3.^1 


3.83 


* 


3.52* 


2. 


Seminar presenters did provide 
adequate question responses. 


2 

3.53 


2 

3.70 


1,2 


3.83 




Questions sent in were valuable in 
highlighting issues. 


(1.01 


3.-89 


2 

■^.21 


i\ . 04 V 


4. 


I^any important qye^tions on topic 
were raised. , . - , 




r 2.95 


. .1 

3.15 


2.991 


5. 


Sufficient opportunity to contribute 
questions. 


^.3Q 


^.^^ 


AM 




6. 


Adequate time allowed for preparation 

and transmission of questions. 

* 


2,3 
^.11 




^•.37 


4.30 


7. 


Seminar discussion interesting. , ' v 


3.88 


5.90 


T,2 

^.27 


.4,02 


8. 


Seminar .presentation was well ^ 
-organized. 


3 


• 3. 
^.18 


1,2 


'4,23^ 


9. 


Seminar discussants expressed ^ 
themselves cTearly. * * 


^ 3 


■ ■ 3 


J ,2 

^.37\ 


^4.13 


10^ 


Presenters expert .in content areas. 


2 




3^ 2 

/I.5C 


V38' 




Seminar helped to better understand 
^course. ^ . . 


3.52 


' 'r 

3.8G 


^, w 


3. BP 


12. 


Seminar compares^ favorably to on- 
site seminar. \ . \ 

9 


2.96 


2.95 


2;95~ 


2.96" 


13. 


Got more out of seminar tha-n 
pjretat)^d lessons. ^ 


2.59 


2.^2 




2.48 


14. 


New material was introduced in 
t'he seminar. . . ^ 1 


2.98 


2.1^ 


3.29 


0 

3.13; 



7: 



♦ 

: -90 

-TABLE F -- CONTINUED 



Item ^ - ^ ^ 


1 ' 


2 


s 

3 , 


Overa Vi 
f'ltem 
Mean. 


15. Opportunity to generate questions most 
valuable aspect of seminar. ^ 


'7'» "7 "7 

3,73 


3.0 3 


"7 "7*0 

3.79 




7 -in. '• 


^ . .* 

16. Time for seminar not top short. 


3 

3.7C 


•3.88 


'i 

3.99 


/ 

1 

3.85 


* ■ ^ 
17-. This was a good time in course . . 
sequence for semifiar. * . ^ • 


3.86 


3.83 




•3.95 


0 1 

18. Wish more of televised lessons 
were seminars. , 


2 . Sji 


2.53 


2.. 73 


2.73^ 


19. Seminar presenters were awar-e of 
^ actual ciassroojn ana community prooiems 


. 3 


3 

J, 1 J 


1,2 


JxOL 


20. Did have a good grasp of new material- 
presented in this seminar. 


2,3' 

2.82 


3.75 


r 

3.9"^ 


3.53, 


21. Film sections of seminar better , 
than discussion sections. 


2.72 


2.51. 


# 


. 2.55 ' 


' Number *of s-ubjects ' . * 
♦ 


- 19^ - 


2ir 


; 219 





.Superscripts associated with a given semina-r mean indica^te the other 
serti.nar means^ that differ significajitly "(P < -OS) by Tukey^HSD test. 

*No j)retaped segments used in seminai7^3. ' • , 

Note: 5-point Likert scale 1 - 'Strongly disagree — 5 =».str(^ngly agree. 
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Mr. Doug Cross 

AESP RESA Director ' 

Clinch-Powell Educational Cooperative 
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AESP RESA Director 

DILENOWKCO Educational Cooperative 

1032 Virginia Avenue 
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